Google Brain

“In my opinion, the outfits that are best positioned for this are Claire from on one side and the new DeepMind now, which is, you know, DeepMind plus Google brain. There are a lot of people there who are interested in that question, and I think they are probabl…”

“Google Brain invents the kind of transformer and publishes it, and it's kind of bouncing around as kind of a research project, and it takes OpenAI developing it, scaling it, and releasing it as ChatGPT for Google to go on red alert and go, oh my god, we should…”

“That, like, 2012 to 20 18 or so era, Google Brain was just, like, incredibly dominant. They did an amazing job picking talent. Like, the people who invented Transformer, the people who invented the diffusion model, people who did all of these new optimization …”

“Cohere. But other than Cohere, I think it's quite distributed at this stage. It used to be very concentrated. It used to be like Google Brain.”

“Well, they weren't in the sense that, like, two weeks after we released the Transformer paper, we started training language models. So we, like, technologically and research-wise Google brain was certainly not behind.”

“I think I was very surprised at how creatively and playfully he approaches research. When we would discuss like algorithms or like optimizers or loss functions, we would discuss them often in like through physical analogy. So we'd spend a lot of time talking a…”

“I would say about 90% of the breakthroughs that underpin the modern AI industry were done either by Google Brain or Google Research or DeepMind, so one of our groups.”