Google Brain, every mention
36 scenes (2025) · ← back to Google Brain
tap a year for its mentions
every year 2025 anyone David Rosenthal 31Ben Gilbert 12
Verbatim, from the transcripts: the passages where Google Brain comes up
Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired
- ▶ 2:41 Ben Gilbert The entire AI revolution that we are in right now is predicated by the invention of the transformer out of the Google brain team in 2017.
- ▶ 35:07 David Rosenthal It's called Google Brain.
- ▶ 35:10 David Rosenthal But before we tell the Google Brain story, now is a great time to thank our friends at JPMorgan Payments.
- ▶ 37:28 Ben Gilbert So Google Brain.
- ▶ 39:20 David Rosenthal And in 2011, the three of them launch the second official project within X, appropriately enough, called Google Brain.
- ▶ 56:17 David Rosenthal Well, that leads to the three of them joining Google Brain directly and turbocharging everything going on there.
- ▶ 56:25 David Rosenthal Spoiler alert, a couple years later, Astro Teller, who would take over running Google X after Sebastian Thrun left, he would get quoted in the New York Times in a profile of Google X that the gains to Google's core businesses in search and…
- ▶ 1:16:10 David Rosenthal And so with Jan, they have created FAIR, Facebook AI research, which is a Google brain rival within Facebook.
- ▶ 1:21:12 David Rosenthal They already have Brain.
- ▶ 1:21:22 David Rosenthal Brain is already working on products within Google.
- ▶ 1:21:34 Ben Gilbert Brain is like actively going and engaging with the product groups, trying to figure out, hey, how can we deploy neural nets into your product to make it better?
- ▶ 1:21:46 David Rosenthal Brain and neural nets are getting integrated into search, into ads, into Gmail, into everything.
- ▶ 1:38:01 Ben Gilbert And was he on Google Brain before this?
- ▶ 1:38:03 David Rosenthal He was on Google Brain, yep.
- ▶ 1:41:49 Ben Gilbert Yes, he went on to be Apple's head of AI, who at this point in time was at Google and oversaw Google Brain 20 14.
- ▶ 1:47:31 David Rosenthal Demand for all of this stuff that's coming out of Google brain is through the roof immediately.
- ▶ 1:50:38 Ben Gilbert That's the framework that Google Brain built to enable researchers to build and train and deploy machine learning models.
- ▶ 1:51:02 David Rosenthal So, somewhat paradoxically, during these years after the founding of OpenAI, yes, some amazing researchers are getting siphoned off from Google and Google Brain.
- ▶ 1:51:14 David Rosenthal But Google Brain is also firing on all cylinders during this time frame.
- ▶ 1:51:26 David Rosenthal And then in 2017, a paper gets published from eight researchers on the Google Brain team.
- ▶ 1:53:41 David Rosenthal But, as teams within Google Brain and Google Translate keep working on it,
- ▶ 1:55:32 David Rosenthal So a team within Google brain starts searching for a better architecture that also has the attractive properties of LSTMs that it doesn't forget context too quickly.
- ▶ 1:57:08 David Rosenthal They get excited about this.
- ▶ 1:59:11 Ben Gilbert So we talked to Greg Corrado from Google Brain, one of the founders of Google Brain, and it was a really interesting conversation because he underscored how elegant the transformer was, and he said it was so elegant that people's response…
- ▶ 2:02:17 Ben Gilbert They were working it into the core business, just like every other time Google Brain came up with something great.
- ▶ 2:39:56 David Rosenthal In May, they replaced Lambda with a new model from the brain team called POM.
- ▶ 2:40:27 David Rosenthal We're merging Brain and DeepMind into one entity called Google DeepMind.
- ▶ 2:40:53 David Rosenthal This is all hands on deck, and you and DeepMind are gonna lead the charge, you're gonna integrate with Google Brain, and we need to change all of the past 10 years of culture around building and shipping AI products within Google.
- ▶ 2:41:46 Ben Gilbert I am taking the responsibility of Google brain and giving it
- ▶ 2:41:51 Ben Gilbert To DeepMind, and DeepMind is absorbing the Google Brain team.
- ▶ 2:42:15 David Rosenthal He had already shifted over to Brain and to Google.
- ▶ 2:43:24 David Rosenthal Okay, so that first big decision that Sundar makes is unifying deep mind and brain.
- ▶ 3:08:27 David Rosenthal One, we're merging Brain and DeepMind into one team for AI within Google, and two, we're gonna standardize on one model, the future Gemini, and DeepMind slash Brain team.
- ▶ 3:08:58 David Rosenthal So, once Sundar makes these decisions, Jeff Dean and Oriol Vinales from Brain go over and team up with the DeepMind team, and they start working on Gemini.
- ▶ 3:53:34 David Rosenthal They are making hard decisions, like, we're unifying deep mind and brain, we're consolidating and standardizing on one model, and we're gonna ship this stuff real fast.
Google Part II: Alphabet (Audio) · Acquired
- ▶ 3:41:29 David Rosenthal Because it is also during this time while Ilya is working at Google that he poses the question to his research colleagues and the Google brain team that is working on all of this.