Bernhardsson: Long-Term GPU Contracts Are the Wrong Model for Startups
Erik Bernhardsson · No Priors Ep. 96 | With Modal CEO and Founder Erik Bernhardsson · Jan 9, 2025 · at 4:47
Modal CEO Erik Bernhardsson discusses GPU resource allocation and cloud pricing models with host Elad Gil.
0:00 / 0:10exact quote · 10.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Means that cloud, you know, a lot of the cloud capacity is like, you know, the only way to get it is to sign long term commitments, which I think for a lot of startups is really not the right model for how things should be.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Erik Bernhardsson
Bernhardsson: AI will expand rather than destroy demand for software engineers
“So I, I'm very bullish on software engineers. I think it would take a lot to sort of destroy that demand. I think people look at a lot of like AI as like a kind of fix something, but in my opinion, it's like, No, it's just gonna unlock more latent demand for m…”
Bernhardsson: Dynamic multi-tenant pooling is the future of AI compute
“I think there's so many benefits of this multi-tenant model in terms of capacity management that to me, it is very clearly like a big part of the future of AI is like running a big pool of compute and slicing it very dynamically.”
Bernhardsson: Companies reliant on model quality must train custom models for defensibility
“I think eventually like for any company where model quality really matters, unless you kind of train your own model in the end, like, I feel like it's going to be hard to sort of defend the fact that like, You know, you're, you have a better solution. Cause li…”
Bernhardsson: Modal Built Custom File System, Scheduler, and Container Runtime
“We can't really use Docker and Kubernetes. So we're going to have to throw that out and probably going to have to build our own file system, which we did pretty early in a build our own scheduler and build our own container runtime. So that was like basically …”