Bernhardsson: Dynamic multi-tenant pooling is the future of AI compute
Erik Bernhardsson · No Priors Ep. 96 | With Modal CEO and Founder Erik Bernhardsson · Jan 9, 2025 · at 12:25
Modal CEO Erik Bernhardsson addresses enterprise cloud friction, arguing dynamic pooling will win out over static reservations due to capacity efficiency.
0:00 / 0:10exact quote · 10.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think there's so many benefits of this multi-tenant model in terms of capacity management that to me, it is very clearly like a big part of the future of AI is like running a big pool of compute and slicing it very dynamically.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Erik Bernhardsson
Bernhardsson: AI will expand rather than destroy demand for software engineers
“So I, I'm very bullish on software engineers. I think it would take a lot to sort of destroy that demand. I think people look at a lot of like AI as like a kind of fix something, but in my opinion, it's like, No, it's just gonna unlock more latent demand for m…”
Bernhardsson: Long-Term GPU Contracts Are the Wrong Model for Startups
“Means that cloud, you know, a lot of the cloud capacity is like, you know, the only way to get it is to sign long term commitments, which I think for a lot of startups is really not the right model for how things should be.”
Bernhardsson: Companies reliant on model quality must train custom models for defensibility
“I think eventually like for any company where model quality really matters, unless you kind of train your own model in the end, like, I feel like it's going to be hard to sort of defend the fact that like, You know, you're, you have a better solution. Cause li…”
Bernhardsson: Modal Built Custom File System, Scheduler, and Container Runtime
“We can't really use Docker and Kubernetes. So we're going to have to throw that out and probably going to have to build our own file system, which we did pretty early in a build our own scheduler and build our own container runtime. So that was like basically …”