Sivulka: AI model layer will commoditize as value accrues to applications and hardware
George Sivulka · George Sivulka, Co-Founder & CEO @Hebbia: The Future of Foundation Models | E1250 · 20VC with Harry Stebbings · Jan 22, 2025 · at 43:08
George Sivulka, founder and CEO of Hebbia, shares his perspective on value capture across the AI stack during an interview with Harry Stebbings on 20VC.
0:00 / 0:46exact quote · 46.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I, you know, I think that ultimately the model layer, and I think this is not a hot take anymore. I've been saying it for a few years, but I think it will become commoditized. I think that a lot of value will accrue at the hardware layer especially And we could talk about what that means for NVIDIA, especially as, ah, you know, NVIDIA has a stranglehold on training, but, you know, ah, not as much a stranglehold on inference, and so you might actually see ah, other chip makers, you know, actually start to, their chips start to be used in a more meaningful way, because, you know, CUDA is what all ML scientists were trained on in their PhDs, but then, you know, inference doesn't matter, ah, kind of what you're using. And I think it will be the infrastructure layer and then actually the application or agent layer that will accrue the most value. Ultimately.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from George Sivulka
Sivulka: Retrieval Augmented Generation (RAG) does not work at all
“That's a bit of a plot twist over here. We, I actually don't think RAG works at all.”
Sivulka: Great founders have messed up childhoods, are gay, or adopted
“You can bucket great founders into three backgrounds. The most common is that you have kind of a messed up childhood. The second most common would be, ah, you're gay, and the third most common would be you were adopted. Look at like a list of all-time greats. …”
Sivulka: ChatGPT is a poor product that acts like a calculator
“I don't even think ChatGPT is a really good product. It's like a calculator. It's got the technology in there encapsulated in a very simple form. But it's not a product that, like in Excel, that lets you just build whatever you'd like with it.”
Sivulka: 90% of enterprise AI is vapor and usage stats are fake
“I think, like, 90% of enterprise AI right now is almost like this vapor where, hey, we swear it works, like, look at this amazing demo where we ask, What does the CEO say about the investment? And the minute that they actually go to, you know, try to use it in…”
Sivulka: Satya Nadella is wrong about business apps collapsing into agents
“I actually don't agree with that at all. I think he's completely wrong. I think it depends on how you define a business app. But I actually think that if the new business apps are platforms, you'll, you'll actually start to see those platforms really take hold…”