next token prediction
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement May 9, 2024 by Jack Clark · across every show →
Everything said about next token prediction, oldest first
May 9, 2024 bullish
Clark: Advancing AI will probably require few complex breakthroughs beyond simple scalable ideas
“And I guess my naive view is the amount of things we'll need to do that are extra special will probably be quite small. And the challenge is coming up with simple ideas like next token prediction, but scale for probably other simple ideas we need to figure out…”