Kohli: Large matrix multiplication algorithms are too intricate for human intuition alone
Pushmeet Kohli · No Priors Ep. 120 | With Google DeepMind’s Pushmeet Kohli and Matej Balog · Jun 26, 2025 · at 9:18
Pushmeet Kohli, VP at Google DeepMind, discusses why breakthrough algorithmic efficiencies in matrix multiplication remained undiscovered by human researchers before AI agents.
0:00 / 0:32exact quote · 32.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“As you sort of go to larger sizes, the space is so huge. The constructions are not sort of something which is very natural. These are very involved and intricate, intricate, intricate sort of constructions that would be very hard to discover by chance. So it's quite interesting that it is, it has this very special structure, but it's not something that is, that comes naturally. Or to a human computer scientist.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Pushmeet Kohli
Kohli: FunSearch made the first scientific discovery generated by an LLM
“FunSearch, which was an LLM-based agent, which for the first time, by searching in the space of programs, showed that you can come up with completely new solutions, like, and this, and made the first scientific discovery from an LLM.”
Kohli: AI self-improvement for cognitive tasks will work with proper evaluators
“It should work.
But as we sort of mentioned that having good evaluators is an important element, right?
And so having a sort of evaluator, which can say this proposal that you have just suggested for me to improve the training process will yield
A good result.…”
Kohli: Multi-agent LLMs outperform base models in hypothesis generation
“And we have shown that this AI co-scientist which we have used for hypothesis generation, it basically uses a multi-agent sort of setup and where LLMs themselves are able to sort of figure out that certain hypotheses are better in terms of novelty and signific…”
Kohli: AlphaEvolve discovered cap set problem symmetries unknown to mathematicians
“Working with Jordan Ellenberg in the first, in the earlier version of Alpha Evolve, when you were working on the cap set problem, the programs that it discovered had very interesting symmetries that that mathematicians did not know about. And so, so not only t…”