trillion tokens
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Feb 12, 2026 by Jeff Dean · across every show →
Everything said about trillion tokens, oldest first
Feb 12, 2026 bearish
Dean: Scaling quadratic attention cannot reach billion- or trillion-token context windows
“But that's not going to be solved by purely scaling the existing solutions, which are quadratic. So a million tokens kind of pushes what you can do. You're not going to do that to a trillion tokens, let alone, you know, a billion tokens, let alone a trillion.”