Scaling
topic on 9 shows · 13 statements across 13 episodes
the Knowledge Project 
Masters of Scale 
Lenny's Podcast 
No Priors 
Top Founders 
the a16z Podcast 
Big Technology 
All-In 
20VC
13 statements about Scaling, every show
Pineau: Continual learning research is disconnected from scaling efforts
“Right now the progress in the research community that's working on continual learning isn't necessarily connecting to the work that's going on on scaling.”
Labenz: AI post-training reasoning currently yields higher ROI than raw scaling
“And it just seems like we're getting more benefit from the post training and the reasoning paradigm than scaling. But I don't think either one is I definitely don't think either one is, is dead.”
Hassabis predicts achieving AGI requires one or two fundamental new breakthroughs
“And so, a lot of these, I think, core capabilities are still missing, and maybe scaling will get us there, but I feel, if I was to bet, I think there are probably one or two missing breakthroughs that are still required and will come over the next five, five o…”
Demis Hassabis confirms AI scaling returns are slowing but remain substantial
“My view is that we are getting substantial returns, but not, but it's slowing vis-a-vis, but it would have to, I mean, it's not just continuing to be exponential, but that doesn't mean the scaling is not working. It's absolutely working.”
Cohen: Scaling post-PMF forces a difficult emotional shift in founder identity
“The stuff, the activity, That got you here won't get you there because there's these other types of behavior which are now correct, and it's a lot of stuff, and I guess the point I really want to make is that this changes who you are and what you are even prou…”
Midha: Recent AI development was dominated by compute and data scaling
“Over the last few years, AI has been dominated by scaling, which is a quest to see what was possible if you threw a ton of compute and data at training these large models.”
Chestnut: Most founders likely walk away when companies transition to scaling
“And I think this is where a lot of founders probably choose to walk away. And it's very difficult to stay.”
Singhal: Scaling professional peer groups destroys member trust and authenticity
“Six went to 12 and then 12 went to 15, and now we have 28 members. And a lot of folks are interested in these types of communities, but I'm so worried about scaling it because it's the enemy of trust and authenticity.”
AI Scaling Has Not Hit a Wall and Will Keep Improving
“So, and at the same time, like, I don't think anyone's seen a wall in terms of how good this stuff is. So I think it will just, it's just gonna keep getting better. I don't know what stops it.”
Reid Hoffman: Scaling requires constantly evolving organizational and individual learning patterns
“I'd say the classic thing is how you have to be constantly evolving your learning pattern. That what got you here won't get you there, and it's across a wide variety of fronts.”
Hoffman: An investor who does not understand you is a massive impediment
“An investor who doesn't understand you is one of the biggest impediments you can have.”
Hoffman: Scaling requires constant mission, fluid tactics, and first-principles guidance
“That's why I believe you need to keep your mission constant, but your tactics fluid as you scale. Let first principles guide you, even as you adapt to new rules.”