Local Models
topic on 5 shows · 13 statements across 10 episodes
More or Less 
Innovators & Investors 
Latent Space 
the Startup Ideas Podcast 
All-In
13 statements about Local Models, every show
Chamath: Using local AI models for enterprise applications is 'stupid'
“I don't think enterprises will use local models or they should. I think it's stupid. I think. I think this stuff should be hosted in the cloud. It should be multiplayer. It should be shared memory.”
Massay: Local AI models will gain traction in high-security applications
“The local models are going to be, I think, more, more popular when it comes to very secure applications, and they don't want to send their data over To somebody like an Anthropic or an OpenAI or, you know, they'd rather keep it all in-house.”
Bayramov: Local AI models usually lag cloud models due to compute constraints
“The local models, most of the time, they are not as good as the cloud models, just because to run a fully fledged AI model on your local hardware, hardware just requires a lot of compute to make it as efficient as the cloud versions.”
Cloud-hosted AI models will continue to outperform local models
“Cloud models are going to be the strongest. You know, they're going to be better than local models. Just in terms of like you're getting the best possible stuff. They're the smartest tool available.”
Local AI on gaming GPUs handles 80% of typical ChatGPT workloads
“Today a model that runs on a gaming GPU or a decent Mac is good enough for about, I would say, 80% of what most people use things like ChatGPT or Cloud for.”
Small local AI models with tools beat giant models without them
“So a small local model with web search, file access, the ability to run code beats a giant model with none.”
Local AI infrastructure acts as insurance against unexpected cloud platform bans
“The lesson is don't build your entire life On something that can disappear with a single letter. Own a part of your stack. Have the generator in the garage. Local models are the insurance, and this is the weekend I finally bought the policy.”
Sanseviero: Local models handle agentic capabilities well, but world knowledge requires scale
“With local models or models that you can run in your own hardware, you can get capabilities, so you can get agent capabilities, function calling, system instructions, like conversational, and that kind of stuff. Knowledge is much trickier, so for knowledge, yo…”
Calacanis: The future of AI is local models on desktop hardware
“I think the future of this is going to be local models running on extraordinary desktop hardware.”
Dave Morin: Apple denies developers direct access to on-device models
“At the same time, the one thing that I was disappointed about is that you cannot access these local models directly. It's something that a lot of folks aren't talking about. They've put a pretty intense wrapper around it, at least on the developer front. You k…”
Soldani: Local models beat closed models in retrieval applications
“There are some applications where local models just blow closed models out of the water. So, like, retrieval is a very clear example.”
Morin: Apple restricts developers from directly accessing its on-device AI models
“The one thing that I was disappointed about is that you cannot access these local models directly. It's something that a lot of folks aren't talking about. They've put a pretty intense wrapper around it, at least on the developer front. You know, you can use t…”