AI training

3 statements across 3 episodes · 0 bullish · 1 bearish · 3 people on the record · first statement Feb 19, 2024 by Erik Bernhardsson · across every show →

Everything said about AI training, oldest first

Feb 19, 2024 negative
Opinion
Buying Dedicated GPU Clusters Offers Better Economics for Model Training
“In training, I think, you know, there's less software differentiation. So in training, I think there's certainly, like, better economics of, like, buying big clusters.”
Erik Bernhardsson Feb 19, 2024 ▶ 37:25 Truly Serverless Infra for AI Engineers - with Erik Bernhardsson of Modal
Apr 11, 2025 neutral
Insight
Conrad: Custom chips make sense for inference, not training experimentation
“It only works if you really know which chip you're going to do. If you don't, then it's a little harder. So it makes, in my head, it makes more sense for inference where you've already established it, but for training there's so much, like, experimentation.”
Evan Conrad Apr 11, 2025 ▶ 20:17 SF Compute: Commoditizing Compute
Jun 13, 2025 neutral
Insight
AI training scales with research teams; inference scales with customer base
“Training scales the size of your research team. Inference scales the size of your customer base.”
Chris Lattner Jun 13, 2025 ▶ 59:12 The Shape of Compute (Chris Lattner of Modular)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.