AI Compute Scaling
topic on 3 shows · 3 statements across 3 episodes
the a16z Podcast
Big Technology
20VC
3 statements about AI Compute Scaling, every show
Casado: AI converts complex scientific exploration into pure capital problems
“No, you're building the machinery. I'm saying in this case, if you're like, I want to exhaustively explore every protein combination. Right. We can just turn that into a money problem. Yeah, yeah. It's kind of very strange.”
Gomez: AI Scaling Gains Will Suffer Diminishing Returns
“I don't think within any achievable scaling up for humanity that will reach that tipping point. It just saturates the gains become much, much smaller. And so you're much less willing to want to pay double the price for a minute difference. But it is pretty con…”
Kolter: AI scaling limits are financial and practical, not physical
“I'm not really sure what the rationale is for saying that we've, we plateaued in the compute sense. Most scaling laws that I've seen certainly suggest it can keep going. It's more expensive. You could argue that it's by far just scaling is, may not be the most…”