Dean: Specialized inference hardware will surpass general GPUs and TPUs
Jeff Dean · Jeff Dean: The 1% Rule for Building in AI · Y Combinator · Jul 30, 2026 · at 3:37
Google Chief Scientist Jeff Dean speaks with YC Managing Partner Diana Hu at Startup School 2026 about hardware shifts needed to scale AI agent systems.
0:00 / 0:36exact quote · 36.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think, ah, you're gonna see more and more, ah high performance and low energy inference hardware systems, because I think everyone is now realizing that inference is the key to making, you know, these agent-based systems be available to more and more people, and that latency is really important, and that specialization of the hardware is a really key way you can make things that are more energy efficient and lower latency than More general purpose computational devices like say GPUs or TPUs.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Jeff Dean
Jeff Dean: AI models have reached junior engineer capability level
“The models have been getting a lot better at sort of agent-based, longer-running coding tasks, and it seems pretty clear that they are now actually pretty capable, and depending on exactly your definition of junior engineer, it seems pretty spot on, I would sa…”
Jeff Dean: AI agents can run autonomously for days or weeks
“Probably one thing is people don't quite realize how possible it is to have, you know, agent based systems that can run not just for an hour or two hours on a problem you care about, but for some problem domains and with highly capable models underlying them, …”
Dean: AI startups should target tasks with 1% model success, not 20%
“If they're completely failing, that's probably a good sign. If they're kind of able to do some of it, but not very well, That's maybe not a great sign because that's probably a sign that the capability is starting to be present in those models and with more tr…”
Jeff Dean: AI models will not have good taste in problem selection
“I think models are not necessarily going to be that good at it. So you're going to have people steering a lot of AI assisted computation in order to accomplish great things and more quickly. But that essence of what it is you want your models to do is the key …”
Jeff Dean: There is no impediment to fully automating ML model research
“There's no, ah, you know, real impediment to making that be a much more automated loop, where the model itself decides it's going to explore, or maybe with a nudge from some people, ah, at the various highest level, like, oh, why don't you try some new ideas a…”