Bernhardsson: Stable Diffusion Release Drove Initial Traction for Modal
Erik Bernhardsson · No Priors Ep. 96 | With Modal CEO and Founder Erik Bernhardsson · Jan 9, 2025 · at 3:13
Modal founder and CEO Erik Bernhardsson reflects on how the release of Stable Diffusion catalyzed developer adoption of Modal's serverless GPU infrastructure.
0:00 / 0:20exact quote · 20.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The main thing that really started driving all the traction was when stable diffusion came out. And a bunch of people came to us and like, Hey, actually, this looks kind of cool. Like you have GPU access. It's very easy to, you know, you have to think about, you know, spinning up machines and provisioning them. And so that was like our first sort of killer app was like just doing gen AI in a serverless way with the focus of diffusion models.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Erik Bernhardsson
Bernhardsson: AI will expand rather than destroy demand for software engineers
“So I, I'm very bullish on software engineers. I think it would take a lot to sort of destroy that demand. I think people look at a lot of like AI as like a kind of fix something, but in my opinion, it's like, No, it's just gonna unlock more latent demand for m…”
Bernhardsson: Long-Term GPU Contracts Are the Wrong Model for Startups
“Means that cloud, you know, a lot of the cloud capacity is like, you know, the only way to get it is to sign long term commitments, which I think for a lot of startups is really not the right model for how things should be.”
Bernhardsson: Dynamic multi-tenant pooling is the future of AI compute
“I think there's so many benefits of this multi-tenant model in terms of capacity management that to me, it is very clearly like a big part of the future of AI is like running a big pool of compute and slicing it very dynamically.”
Bernhardsson: Companies reliant on model quality must train custom models for defensibility
“I think eventually like for any company where model quality really matters, unless you kind of train your own model in the end, like, I feel like it's going to be hard to sort of defend the fact that like, You know, you're, you have a better solution. Cause li…”
Bernhardsson: Modal Built Custom File System, Scheduler, and Container Runtime
“We can't really use Docker and Kubernetes. So we're going to have to throw that out and probably going to have to build our own file system, which we did pretty early in a build our own scheduler and build our own container runtime. So that was like basically …”