larger models

3 statements across 2 episodes · 3 bullish · 0 bearish · 2 people on the record · first statement Nov 2, 2023 by Ilya Sutskever · across every show →

Everything said about larger models, oldest first

Nov 2, 2023 bullish

Prediction Not checkable as stated

Sutskever: Larger AI models will unlock unprecedented value over small models

“I do think though that as models continue to get larger and better, then they will unlock new and unprecedentedly valuable applications. So yeah, the small models will have their niche for the less interesting applications, which are still very useful.”

Ilya Sutskever Nov 2, 2023 ▶ 20:57 No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever

Nov 9, 2023 positive

Opinion

Mensch: Advancing reasoning capabilities requires scaling to larger models

“There's still a limit to what a certain model size can do. This limit was, I think, underestimated. But if you want to get to more reasoning capabilities, you do need to move into larger models.”

Arthur Mensch Nov 9, 2023 ▶ 8:28 No Priors Ep. 40 | With Arthur Mensch, CEO Mistral AI

Nov 9, 2023 bullish

Disclosure

Mensch: Distilling state-of-the-art small models requires training massive models first

“The other thing about moving into larger models is that it enables you to train smaller models that are better, which is through variety of techniques like distillation or synthetic data generation. So this, these two things are quite related. If you want to m…”

Arthur Mensch Nov 9, 2023 ▶ 8:42 No Priors Ep. 40 | With Arthur Mensch, CEO Mistral AI

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

larger models

Everything said about larger models, oldest first

Turn any episode into a week of clips.