ten million tokens

1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Aug 31, 2023 by Eugene Cheah · across every show →

Everything said about ten million tokens, oldest first

Aug 31, 2023 bearish

Prediction Didn’t hold up

Cheah: Standard Transformers Will Never Scale to Ten Million Tokens

“I think what was quick, I think it was rather quick after I concluded that transformer as it is will not scale to ten million tokens.”

Eugene Cheah Aug 31, 2023 ▶ 20:25 RWKV: Reinventing RNNs for the Transformer Era

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

ten million tokens

Everything said about ten million tokens, oldest first

Turn any episode into a week of clips.