Google merged DeepMind and Google Brain because separate scaling made no sense
Shane Legg · AI is smarter than you think with Shane Legg of Google DeepMind · Apr 11, 2024 · at 19:38
Shane Legg, co-founder and Chief AGI Scientist of Google DeepMind, explains the internal rationale behind combining DeepMind and Google's AI research divisions in 2023.
0:00 / 0:35exact quote · 35.3s
720p mp4 · rendered on demand · StarZero watermark
“It was becoming clear that extremely scaled up models were going to become a really important thing in the future. And, you know, for Google it was important that we had the biggest and best models. And it doesn't make sense to have, you know, two different groups both developing big models. We needed to, you know, come together. We both had a lot of expertise in this sort of thing. Come together and use all the, you know, resources in terms of all the people together and then all the compute and everything to make the best models we possibly could.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Shane Legg
Shane Legg estimates a 50% chance of AGI by 2028
“So I actually came up with an estimate then that it was about a 50% chance of what I call AGI now by about 20 28.”
Shane Legg defines AGI as matching all typical human cognitive tasks
“And to be clear, the way I define artificial general intelligence is it's an artificial agent that can do all the kinds of cognitive tasks that people can typically do and possibly more.”
Shane Legg argues there is no feasible global way to halt AI
“Intelligence is profoundly valuable for many, many reasons, and I don't know of any way to globally get everybody to stop using and developing this very, very valuable technology. And so, as far as I can see, this will be developed”
Legg: AI will surpass human-level AGI to achieve artificial superintelligence
“So that definition of AGI to me is the bar, that's the entry level into AGI, but I do not think that's where it stops. I think you start going into what they call ASI, or artificial superintelligence, and it may be the case in certain dimensions is the scaling…”
OpenAI realized Google's Transformer architecture scaled far better than anyone appreciated
“Another company, OpenAI, latched onto the idea that this is, in fact, extremely scalable, more scalable than anybody had appreciated. And they just basically scaled it up and scaled it up and scaled it up.”
DeepMind folded all known proteins; 1.7 million researchers use the database
“What we did is we folded all the proteins known to science, and we released them all to the public for free, so you can find them all online on the internet, and you can look at the shapes and so on, and we've had about 1.7 million researchers use that resourc…”