This is relevant also: https://hazyresearch.stanford.edu/blog/2023-03-07-hyena

		daemonk on July 6, 2023 \| parent \| context \| favorite \| on: Scaling Transformers to 1B Tokens This is relevant also: https://hazyresearch.stanford.edu/blog/2023-03-07-hyena