Murdock: Merging LLMs and reinforcement learning will drive major AI breakthroughs
Colin Murdock · Google's DeepMind Wants To Make Human-Level Artificial Intelligence, Says Its Chief Business Officer · Sep 14, 2023 · at 50:27
Colin Murdock, Chief Business Officer at Google DeepMind, discusses what will drive the next wave of major AI capabilities beyond basic LLMs.
0:00 / 0:19exact quote · 19.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I don't know exactly what the breakthrough will be, but I'm really excited about the union of these LLMs plus reinforcement learning. And I'm excited about that because I think there's a lot more to come from reinforcement learning. And I know at Google D mine, we have great deal of expertise in that. So I expect to see the fusion of those two things create some really powerful and important breakthroughs.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Colin Murdock
DeepMind CBO: AGI will traverse branching scientific problems at unimaginable scale
“Once we solve one problem that typically opens up and shows this kind of branching set of new problems, the AGI system will be able to kind of trans translate across that problem space at a speed and scale that we can't even imagine today.”
Murdock: DeepMind's MuZero algorithm dramatically reduces YouTube streaming bandwidth
“We were able to take an algorithm developed for games. That was a master in chess and use that to dramatically reduce the bandwidth requirement to stream YouTube videos.”
Murdock: AI research has not yet reached the limits of model scaling
“We haven't necessarily reached the limit of making these models bigger either. We're not, no one's quite sure where that limit is.”
Murdock: Google's Gemini accepts and outputs both text and images natively
“One of the really important areas it's touching on is what we call multi-modality. It's a bit like the human senses you just described. We can kind of use all our human senses together and combined to achieve the goal where we're setting out to. So it will bri…”