StarZero All shows Try the podcast clipper →

next token prediction

also referred to as: next-token prediction

3 statements across 3 episodes · 0 bullish · 1 bearish · 3 people on the record · first statement Apr 25, 2023 by Dr. Percy Liang · across every show →

Everything said about next token prediction, oldest first

Apr 25, 2023
Insight
Liang: Next-token prediction forces language models to build world models
“If you think about predicting the next word, It's, it seems very simple, but you have to really internalize a lot of what is going on in this context. What are the previous words? What's the syntax? What's who's saying them? And all of that information and con…”
Dr. Percy Liang Apr 25, 2023 ▶ 24:54 No Priors Ep. 7 | With Stanford Professor Dr. Percy Liang
Apr 25, 2023 bearish
Prediction Not checkable as stated
Next-token prediction will not replace big-company software engineers
“Like next, next token prediction is going to, is getting you surprisingly far. But I don't think it's gonna get you all the way there to like replacing, you know engineers at big companies.”
Noam Brown Apr 25, 2023 ▶ 37:25 No Priors Ep. 1 | With Noam Brown, Research Scientist at Meta
Oct 23, 2025 neutral
Prediction Not checkable as stated
Lloyd: Human brains don't use next-token prediction; another AI unlock is coming
“Something I'm always thinking about is like, is this how our brains are working? Are we doing next Token prediction, and I don't think so. Like, I think that there's gonna be some further AI unlock.”
Zach Lloyd Oct 23, 2025 ▶ 1:20 No Priors Ep. 137 | With Warp Co-Founder & CEO Zach Lloyd
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more