language modeling

2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Apr 25, 2023 by Noam Shazeer · across every show →

Everything said about language modeling, oldest first

Apr 25, 2023 positive
Insight
Shazeer Calls Next-Token Prediction an AI-Complete Problem
“And like, the problem is super simple to define. It's just like predict the next word, the fat cat sat on the, you know, like, okay, well, you know, what comes next? Like it's extremely easy to define. And if you can do a great job of it, like, you know, then …”
Noam Shazeer Apr 25, 2023 ▶ 3:03 No Priors Ep. 12 | With Noam Shazeer
Jun 27, 2024 positive
Assertion Supported
Gu: Mamba successfully applied state-space models to language modeling
“Recently proposed a model called Mamba which was kind of brought these to language modeling and showed really good results there.”
Albert Gu Jun 27, 2024 ▶ 2:24 No Priors Ep. 70 | With Cartesia Co-Founders Karan Goel & Albert Gu
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.