Hassabis: Long-context windows in AI are a brute-force approach to memory
Demis Hassabis · Demis Hassabis: Why AGI is Bigger than the Industrial Revolution & Where Are The Bottlenecks in AI · 20VC with Harry Stebbings · Apr 7, 2026 · at 8:07
Demis Hassabis, Co-Founder and CEO of Google DeepMind, discusses algorithmic limitations and the need for new memory architectures in AI models on the path to AGI.
0:00 / 0:04exact quote · 4.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“At the moment we have these long context windows, which are kind of a bit brute force. You just put everything in them.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Demis Hassabis
Hassabis: Google and DeepMind developed 90% of modern AI breakthroughs
“I would say about 90% of the breakthroughs that underpin the modern AI industry were done either by Google Brain or Google Research or DeepMind, so one of our groups.”
Hassabis: There is a very good chance AGI arrives within five years
“I mean, I think, look, I've got a probability distribution around the timings, but I would say there's a very good chance of it being within the next five years.”
Hassabis: AGI impact will be 10x the Industrial Revolution at 10x speed
“I sometimes quantify the coming of AGI as 10 times the industrial revolution at 10 times the speed.”
Hassabis: Algorithmic innovation will soon drive AI advantages over pure scaling
“Those labs that have Capability to invent new algorithmic ideas are going to start having bigger advantage over the next few years. As the last set of ideas, all the juices being wrung out of them.”
Hassabis: DeepMind's 2010 prediction of a 20-year AGI timeline remains on track
“We used to do this extrapolation of compute and algorithmic progress, and basically we predicted around 20 years it would take from when we started out, and I think we're pretty much on track.”
Hassabis: Open-source AI models will lag frontier proprietary models by six months
“I think increasingly you know, what you're gonna see is the open source models are probably one step back from the absolute frontier. You know, it usually takes about six months for the open source community to sort of re-implement and figure out what those id…”