Everything Jeff Dean said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Jeff Dean: AI models have reached junior engineer capability level
“The models have been getting a lot better at sort of agent-based, longer-running coding tasks, and it seems pretty clear that they are now actually pretty capable, and depending on exactly your definition of junior engineer, it seems pretty spot on, I would sa…”
Dean: Specialized inference hardware will surpass general GPUs and TPUs
“I think, ah, you're gonna see more and more, ah high performance and low energy inference hardware systems, because I think everyone is now realizing that inference is the key to making, you know, these agent-based systems be available to more and more people,…”
Jeff Dean: AI agents can run autonomously for days or weeks
“Probably one thing is people don't quite realize how possible it is to have, you know, agent based systems that can run not just for an hour or two hours on a problem you care about, but for some problem domains and with highly capable models underlying them, …”
Dean: AI startups should target tasks with 1% model success, not 20%
“If they're completely failing, that's probably a good sign. If they're kind of able to do some of it, but not very well, That's maybe not a great sign because that's probably a sign that the capability is starting to be present in those models and with more tr…”
Jeff Dean: AI models will not have good taste in problem selection
“I think models are not necessarily going to be that good at it. So you're going to have people steering a lot of AI assisted computation in order to accomplish great things and more quickly. But that essence of what it is you want your models to do is the key …”
Jeff Dean: There is no impediment to fully automating ML model research
“There's no, ah, you know, real impediment to making that be a much more automated loop, where the model itself decides it's going to explore, or maybe with a nudge from some people, ah, at the various highest level, like, oh, why don't you try some new ideas a…”
Jeff Dean: Analog computing loses power advantages at digital boundaries
“I mean, I think there's still a, there's also sort of the more exotic things like analog based computing substrates as opposed to digital ones.
I'm, you know, I think those are super interesting cause they can be potentially low power.
but I think you often …”
Dean: General AI models will win out over specialized ones
“I mean, I think general models will win out over specialized ones in most cases.”
Jeff Dean: Inference-time compute search improves reliability in agent workflows
“Inference time compute to perform search over plausible ways of solving the problem that can get much, much higher performance or much more reliability in, Long-running agent flows.”
Dean: AI coding agents make crisp software specifications more important than ever
“The importance of specifying what you, what it is you want has actually gone up, because before you'd be handing it off to a very intelligent human who maybe has context or can ask you follow-up questions and agents can sometimes do that, but I think clear spe…”
Jeff Dean: Frontier AI models consume 1,000x more data than 18-year-old humans
“If you think about our large scale models today, they probably see a thousand times as much data as a human does by the age of 18, yet the human by the age of 18 is better in a lot of things and, you know, on par with those frontier models that have seen way m…”
Jeff Dean: Capable small models require first building frontier models
“Through distillation, which is a key technique for making the smaller models more capable, you know, you have to have the frontier model in order to then distill it into your smaller model. So it's not like an either or choice. You sort of need that in order t…”
Jeff Dean: Teacher model logits enable small models to learn from multi-pass training
“One of the key advantages of distillation is that you can have a much smaller model And you can have a very large you know, training data set and you can get utility out of making many passes over that data set because you're now getting the logits from the mu…”
Dean: Next-gen Gemini Flash matches or beats prior-gen Gemini Pro
“For multiple Gemini generations now, we've been able to make the sort of flash version of the next generation as good or even substantially better than the previous generations pro, and I think we're gonna keep trying to do that because that seems like a good …”
Jeff Dean: Low latency is critical as AI shifts to complex multi-token tasks
“Latency is actually a pretty important characteristic for these models, because we're gonna want Models to do much more complicated things that are going to involve, you know, generating many more tokens from when you ask the model to do something until it act…”
Dean: Scaling quadratic attention cannot reach billion- or trillion-token context windows
“But that's not going to be solved by purely scaling the existing solutions, which are quadratic. So a million tokens kind of pushes what you can do. You're not going to do that to a trillion tokens, let alone, you know, a billion tokens, let alone a trillion.”
Jeff Dean: Gemini was designed to ingest Waymo LIDAR and robotics telemetry
“I think one of the things about Gemini's multimodal aspects is we've always wanted it to be multimodal from the start. And so, you know, that sometimes to people means text and images and video sort of human-like and audio, audio, human-like modalities, but I …”
Jeff Dean: LLM search funnels trillions of tokens down to 100 documents
“And I think an LLM based system is not going to be that dissimilar, right? You're going to tend to trillions of tokens, but you're going to want to identify, you know, what are the 30,000 ish documents that are with the, you know maybe Thirty million interesti…”
Jeff Dean: Design systems to scale 5x to 10x, not 100x
“And I think a good design principle is you're going to want to design a system so that the most important characteristics could scale by like factors of five or 10, but probably not beyond that, because often what happens is if you design a system for X and so…”
Dean: Applying RL to non-verifiable domains would dramatically improve AI models
“How do you get RL to work for non-verifiable domains? I think it's a pretty interesting open problem because I think that would broaden out the capabilities of the models, the improvements that you're seeing in both math and coding if we could apply those to o…”
Dean: Adding training data for hundreds of languages displaces other model capabilities
“We're always making these kind of you know, trade-offs in the data mix that we train the base Gemini models on. You know, we'd love to include Data from 200 more languages and as much data as we have for those languages. But that's going to displace some other…”
Dean: Sparse models offer 10x compute cost efficiency over dense models
“That gave you like a 10 X improvement in, you know, time to quality. Or compute cost to a given quality level relative to non-sparse models.”
Dean: A one-page internal memo sparked the Gemini unification effort
“I actually wrote a one-page memo saying we were being stupid by fragmenting our resources. So in particular at the time we had you know efforts within Google research on and in the brain team in particular on large language models. We also had efforts on multi…”
Dean: Software development will shift to managing independent AI agent teams
“And so I do think there's going to be more of a style of having lots of independent software agents off doing things on your behalf and figuring out the right sort of human computer interaction model and UI and so on for, When should it interrupt you and say, …”