Everything Erik Bernhardsson said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Bernhardsson: GPU alt-clouds are real estate businesses adding little stack value
“It's like sort of like almost like real estate, right? Like they own sort of, you know, real estate and they rent it out, arguably sort of, you know, we work, you could say, if you want to be, you know, a little cynical, but like not a ton of value, like highe…”
AI Productivity Gains Will Ultimately Increase Demand for Software Engineers
“Like, I think we can, you know, 10 x the amount of developers, and still, you know, have a lot of people making a lot of money, you know, building amazing software, and also being, while at the same time being more productive. Like, I never understood this, li…”
Bernhardsson: AI will expand rather than destroy demand for software engineers
“So I, I'm very bullish on software engineers. I think it would take a lot to sort of destroy that demand. I think people look at a lot of like AI as like a kind of fix something, but in my opinion, it's like, No, it's just gonna unlock more latent demand for m…”
Bernhardsson: LLM inference compute is shifting toward specialized chips like crypto mining
“I do think it's kind of fascinating how it's like kind of going in the same direction as like crypto mining towards more like specialized hardware.”
Bernhardsson: Modal discarded Kubernetes and Docker to build a custom stack
“So we built our own, we threw out Kubernetes out the window. We threw out Docker out the window. We built our own File system in order to optimize for how container images are distributed. We built our own scheduler in order to maintain this pool of workers an…”
Bernhardsson: AI inference spend will dominate model training spend long-term
“It's obvious that like in the long run, like inference spend will dominate just for like the obvious reason that like, that's where you make the money, right? Like, you know, when you're training a big model, that's like, you know, you, you're spending a lot o…”
Bernhardsson: Serverless architecture fits AI workloads better than web backends
“So it's sort of always felt to me like, you know, in, in hindsight, it looks like the right idea, but applied to the wrong problems. And I always like wonder, you know, now, like I'm looking at like what we built at modal. Like I I'm kind of convinced that lik…”
Bernhardsson: Demands for self-hosting mean the product isn't compelling enough
“One trap that I think a lot of startups fall into is that, you know, you go out and talk to a lot of customers and they sort of insist on, on self-hosting. In my opinion, like, you know, sometimes that's actually like a true, like hard concerns, but in many ca…”
Bernhardsson: Lower GPU prices increase value of developer AI software
“If GPU prices were to crash, like the relative value of that software actually goes up. So like, I'm not necessarily sure that like a crash in GPU would be bad for us. I think it actually could be great for us because, you know, if GPU prices go down, there's …”
VCs Subsidizing AI Inference Will Not See Their Expected Returns
“In the end, like, I don't think VCs will have the return they expected. Like, you know, in these things, but guess who's going to benefit? Like, you know, it's the consumers, right? Like someone's like reaping that the value of this. And that's, I think an ama…”
Startups Must Build Deep Infrastructure Rather Than Thin Kubernetes Wrappers
“And so one of my frustrations has been like so many startups are like, in my opinion, like Kubernetes wrappers and like, you know, like, and not very like thick wrappers, like fairly thin wrappers. And I think, you know, every startup is a wrapper to some exte…”
Bernhardsson: Long-Term GPU Contracts Are the Wrong Model for Startups
“Means that cloud, you know, a lot of the cloud capacity is like, you know, the only way to get it is to sign long term commitments, which I think for a lot of startups is really not the right model for how things should be.”
Bernhardsson: Dynamic multi-tenant pooling is the future of AI compute
“I think there's so many benefits of this multi-tenant model in terms of capacity management that to me, it is very clearly like a big part of the future of AI is like running a big pool of compute and slicing it very dynamically.”
Bernhardsson: Companies reliant on model quality must train custom models for defensibility
“I think eventually like for any company where model quality really matters, unless you kind of train your own model in the end, like, I feel like it's going to be hard to sort of defend the fact that like, You know, you're, you have a better solution. Cause li…”
Bernhardsson: People will train many custom AI models in the long run
“Like, so, I don't know, I'm a big believer that, like, you know, in the long run, like, people will train a lot of different custom models.”
Bernhardsson: Companies training their own LLMs makes almost no sense
“A couple of years ago, you know, a lot of companies try to train their own LMs. Like that to me, it makes almost no sense, right?”
Bernhardsson: Nvidia H100 GPU prices are falling significantly
“For a while, like, each 100 prices were, like, almost, like, going up, and then they were kind of still for a while, and then now they're, like, actually going down quite a lot, like, you know, what I'm seeing in the market, right?”
Bernhardsson: Early engineering teams thrive with far less formal management
“You can actually get much further, which a lot less of that than you, than people think is my experience. And you're actually better off doing that because you sort of retain people's autonomy. You retain people's ability to sort of, you know, come up with sol…”
Kubernetes Works for Backend Teams but Fails Data Teams
“Like in particular, like Kubernetes, I feel like it's like kind of worked okay for backend teams, but not so well for data teams.”
AWS Has Always Struggled With Developer Experience
“AWS has always like struggled with developer experience”
Developer Productivity Will Continue Growing 10x Per Decade
“You look at the developers are, I've been getting like probably 10 X more productive every decade for the last four, four decades or something that was kind of crazy. Like on an exponential scale, we're talking about 10 X or is there a 10,000 X like, you know,…”
Serverless Architecture Fits Generative AI Far Better Than Backend Services
“Serverless always, to me, felt like a little bit of, like, a solution looking for a problem. I don't know, I don't actually, like, don't think, like, backend is, like, the problem that needs serverless, or, like, not as much, but I look at data, and in particu…”
Modal Users Save Money on Inference Despite Higher GPU Rates
“In many cases, like users who do inference on those platforms or those clouds even though we charge a slightly higher price per, per GPU hour, a lot of users like moving their large scale inference use cases to model, like end up saving a lot of money because …”
VCs Will Eventually Force Modular to Offer a Hosted Cloud Service
“I'm sure their VCs at some point are gonna force them to reconsider.”