Closed Models
topic on 7 shows · 12 statements across 11 episodes
BG2 Pod 
Latent Space 
No Priors 
the MAD Podcast 
All-In 
TBPN 
20VC
12 statements about Closed Models, every show
Mensch: Open AI models allow parameter addition impossible with closed models
“If you have open models, you can actually add new parameters. You can make a lot of deeper things that you cannot do with closed models.”
Karpathy: Open source trails closed frontier AI models by 6 to 8 months
“So there may be, they're behind by like, what is the latest, maybe like eight months, six months, eight months kind of thing right now.”
Osika: The best AI models will always remain closed-source
“I think the best ones will always be closed but if you want maximal flexibility and some kind of open ecosystem around it might be that open ones are the ones that most people choose.”
Swyx: AI inference providers are a proxy for the open-versus-closed model gap
“The other thing I always think about from a finance point of view that, Maybe people don't even think, don't think about that closely, but obviously push back if you disagree, is that it's basically a proxy for the gap between open models and closed models. Be…”
Sankar: Open AI models have converged with and surpassed closed models
“If you look at both open and closed models over time, you know, the ELOs are just up and to the right. The open ones have converged and even in some cases surpassed closed models.”
Arvind Jain: Most enterprise AI use cases rely on closed models
“Today, the, for most customer use cases the companies are using the closed, closed models at the moment”
Soldani: 2024 open models rival frontier performance of closed models
“You have models that are, you know, reveling frontier level performance of what you can get from closed models, from like Quen, from Deep Seek. We got Lama III.”
Soldani: Local models beat closed models in retrieval applications
“There are some applications where local models just blow closed models out of the water. So, like, retrieval is a very clear example.”
Kolter: Closed-source models leading open-weight releases creates a necessary safety buffer
“At least for now, there's a constant stream of closed models that are released sometime before an equivalently capable open, open weight model, right? And I think this is actually a very good thing because my hope would be that, and we've sort of found ourselv…”
Gerstner: Closed AI model startups besides OpenAI will struggle to raise funding
“I think it's going to be very difficult for new entrants to be venture backed because to, you know, open AI will continue to get funding because they have this incredible team. They have a hundred million people using the product and paying them for the produc…”
Palihapitiya: Open-source AI will win if closed models cannot deploy fast enough
“If you can't both train and deploy iteratively and quickly enough, these open source alternatives will win, and as a result, the economic potential that you have to monetize those models will not be there”
Stuhlmüller: Closed-source models consume most of Elicit's compute budget
“I'd say, like, in terms of number of careers, it's maybe similar. In terms of, like, cost and compute, I think the closed models make, make up more of the budget, since the main cases where you want to use closed models are cases where they're just smarter, wh…”