token by token generation
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Apr 25, 2023 by Matei Zaharia · across every show →
Everything said about token by token generation, oldest first
Apr 25, 2023 negative
Zaharia: Linear token generation is inadequate for complex reasoning and planning
“This kind of token by token generation we're doing now is not an amazing format for reasoning because you have to like linearly, like do one, say one thing at a time. So it's not really good for like making plans or comparing versions. I think to get a really …”