Token By Token Generation
topic on 1 show · 1 statements across 1 episodes
1 statements about Token By Token Generation, every show
Zaharia: Linear token generation is inadequate for complex reasoning and planning
“This kind of token by token generation we're doing now is not an amazing format for reasoning because you have to like linearly, like do one, say one thing at a time. So it's not really good for like making plans or comparing versions. I think to get a really …”