Google, every mention
58 scenes (2023), the whole family · ← back to Google
tap a year for its mentions
every year 2023 anyone Shawn Wang 216Alessio Fanelli 62Dylan Patel 56Yi Tay 42Will Bryk 24Bret Taylor 19Jeremy Howard 18Omar Sanseviero 16Anjney Midha 16Varun Mohan 15
Verbatim, from the transcripts: the passages where Google comes up
The "Normsky" architecture for AI coding agents — with Beyang Liu + Steve Yegge of SourceGraph
- ▶ 0:45 Shawn Wang Uh, you also interned at Google. 5 times in the scene
- ▶ 0:55 Beyang Liu Well, the end user thing was, uh, Google Code Search. 5 times in the scene
- ▶ 11:08 Beyang Liu It's, it's a bit like saying, you know, what's the difference between Google and AltaVista? 2 times in the scene
- ▶ 16:54 Steve Yegge I know that when, uh, ChatGPT launched, so within the last year, I've heard a lot of, you know, rumblings from inside of Google, right? 3 times in the scene
- ▶ 33:21 Steve Yegge When I went to Google, Peter Norvig was already there.
- ▶ 49:26 Steve Yegge And, uh, so Google's internal protocol is gRPC based, and, uh, it's, uh, it is, uh, it's a different approach than LSP.
- ▶ 1:09:50 Steve Yegge I mean, that one Googler that was predicting that, right, open source would catch up.
- ▶ 1:17:32 Beyang Liu Um, the, the real problem that we're facing, I mean, Quinn, myself, and you, Steve, at Google, was like, how do we make sense of the code that exists so we can understand enough to know what code needs to be written?
- ▶ 1:20:24 Shawn Wang Like, I, I typically think of Cody as a Chrome, uh, VS Code extension, but you have a web version where you just plug in any repo in there and just talk to it.
- ▶ 1:32:32 Steve Yegge You have to, you know, just like talking to GPT, they'll give you the run around, just like doing a Google search sometimes.
The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis
- ▶ 3:17 Dylan Patel That, uh, Microsoft, Azure, and Google Cloud just don't even match in terms of efficiency.
- ▶ 3:22 Dylan Patel Like, if you think about the cost to rent out, uh, SSD space, so the cost to rent, you know, offer database service on top of that, obviously, uh, cost to rent out a certain level of CPU performance, um, Amazon has a massive advantage…
- ▶ 5:22 Alessio Fanelli He said, incredible Google got the semi-analysis guide to publish their internal marketing recruiting chart. 6 times in the scene
- ▶ 5:45 Dylan Patel Me, myself, and my colleagues is like, we go from software all the way through to like low-level manufacturing, and it's like, who, you know, oh, Google's actually ramping up TPU production massively, right?
- ▶ 6:05 Dylan Patel That's like a very closely guarded secret, and most people that work at Google DeepMind don't even know that number, right?
- ▶ 10:54 Alessio Fanelli That makes sense, and the, the chart that Sama mentioned, uh, is about, yeah, Google TPU B-Fives completely overtaking OpenAI by, like, orders of magnitude. 5 times in the scene
- ▶ 11:08 Alessio Fanelli We had, um, Chris Landner on the show, which I know, you know, um, he used to work on TensorFlow and Google, and he did mention that 4 times in the scene
- ▶ 21:41 Dylan Patel Uh, so the TPUs, uh, so, so the Google TPU is, like, super interesting because Google's been working with Broadcom, who's the number one networking company in the world, right? 7 times in the scene
- ▶ 24:49 Dylan Patel Like, the whole point was that, like, Google, you know, OpenAI, who everyone would be like, 4 times in the scene
- ▶ 26:56 Dylan Patel Or maybe they let it run on the lap, on the, on the device, but it's like only their pixel phone, you know, kind of like a walled garden thing.
- ▶ 35:38 Dylan Patel like, yeah, so like, Mina Eats the World was basically, he wrote an internal document, uh, around the time where Google had Mina, right, and Mina was, uh, their, you know, was one of their LLMs that, like, is a footnote in the history,… 4 times in the scene
- ▶ 42:01 Dylan Patel We've written a lot about it, but, you know, to simplify it, NVIDIA has a little bit more than half, and Google has, like, 30%, right, through Broadcom. 5 times in the scene
- ▶ 43:20 Dylan Patel And, and hey, that's Google Cloud, you know, after moving the TPU team, you know, into the cloud team, infrastructure team, sort of, they're much more aggressive on external selling, and so companies like, even companies like Apple using…
- ▶ 47:35 Dylan Patel You know, this is the same, like, like playing field as companies like Microsoft and Google, like, like, like Google wants to also deliver hundreds of trillions of dollars of value. 4 times in the scene
- ▶ 49:34 Dylan Patel Difficult to see anyone truly pivoting to anything besides a GPU and a TPU, especially if you have, if you need that scale, right? 2 times in the scene
- ▶ 52:18 Dylan Patel Uh, maybe I'll buy a Pixel this year, the new one looks nice, but, like, it's like, you know how many bugs are on these things?
- ▶ 55:25 Dylan Patel I know Google's a lot more gated with Gemini information, but like, you know, these three, it's like security through obscurity, and it's like, this doesn't ever work.
- ▶ 59:06 Dylan Patel Um, there's the Google infrastructure supremacy piece. 4 times in the scene
- ▶ 59:09 Dylan Patel I think that one's really, uh, uh, critical because it explains Google's infrastructure, uh, quite a bit from networking through chips, through all that sort of history of the TPU a little bit, and all this sort of stuff. 2 times in the scene
- ▶ 1:01:57 Dylan Patel They left the, like, you know, a lot of, most people left the culture of, like, Google Brain and DeepMind and, and decided to build this, like, company that's crazy cool, right?
- ▶ 1:01:57 Dylan Patel They left the, like, you know, a lot of, most people left the culture of, like, Google Brain and DeepMind and, and decided to build this, like, company that's crazy cool, right?
Beating GPT-4 with Open Source Models - with Michael Royzen of Phind
- ▶ 3:01 Michael Royzen It worked so well that, um, it actually worked better than Google Lens, um, which released its V-One around the same time. 2 times in the scene
- ▶ 18:41 Michael Royzen Like we really thought of them like, um, the Google featured snippets, but on steroids. 3 times in the scene
Powering your Copilot for Data - with Artem Keydunov from Cube.dev
- ▶ 2:22 Artem Keydunov So it was, like, some, you know, developer data, like New Relic, you know, maybe, maybe some marketing data, Google Analytics, and then some just regular data, like a production database or so with Salesforce sometimes.
- ▶ 39:48 Artem Keydunov Natural language models being deployed like a Google Translate or something that was, it still was a sort of a model, right?
Why AI Agents Don't Work (yet) - with Kanjun Qiu of Imbue
- ▶ 10:54 Kanjun Qiu We like go Google things and try to figure things out.
- ▶ 57:57 Shawn Wang Um, I think the scaling laws paper from OpenAI was, like, the biggest, and from Google, I think, was, uh, the greatest public service to machine learning that, uh, that any research lab can do.
The End of Finetuning — with Jeremy Howard of Fast.ai
- ▶ 17:01 Jeremy Howard I mean, even like, so we were scooped a little bit by, um, Dai and Lee Kwok Lee at Google.
- ▶ 33:57 Jeremy Howard So Google had just released their TPUs, and so I heard from my friends at Google that they had put together this big team to, to smash Dawn Bench so that they could prove to people that they had to use Google Cloud and use their TPUs and… 4 times in the scene
- ▶ 33:57 Jeremy Howard So Google had just released their TPUs, and so I heard from my friends at Google that they had put together this big team to, to smash Dawn Bench so that they could prove to people that they had to use Google Cloud and use their TPUs and…
- ▶ 55:25 Jeremy Howard So, I met Chris, I think it was at the first TensorFlow Dev Summit, and I don't think he had even, like, I'm not sure if he'd even officially started his employment with Google at that point, so 6 times in the scene
RAG is a hack - with Jerry Liu of LlamaIndex
- ▶ 3:20 Jerry Liu And if you imagine, like, um, kind of back then, it was like, okay, you have Google, which is, like, for search, but then you have Quora, which is just, like, user-generated, like, grassroots-type content.
- ▶ 54:56 Jerry Liu Um, in terms of the most popular tools, uh, or the data loaders, I think we have Google Analytics on this, and I forgot the specifics. 2 times in the scene
- ▶ 55:10 Jerry Liu Uh, Google, like I think Gmail and like G drive. 2 times in the scene
- ▶ 55:10 Jerry Liu Uh, Google, like I think Gmail and like G drive.
Generating your AI Media Empire - with Youssef Rizk of Wondercraft.ai
- ▶ 4:39 Youssef Rizk It wasn't Google.
- ▶ 52:58 Youssef Rizk ChatGPT, like, yeah, fine, they had a first mover advantage, and I think, you know, by no means, this is my opinion, but by no means was Google, like, caught off guard with this, right? 3 times in the scene
- ▶ 1:04:44 Youssef Rizk Very, very soon, like, Google is just gonna mark things as AI generated.
- ▶ 1:07:21 Youssef Rizk Yeah, Google doesn't grade Microsoft. 4 times in the scene
RWKV: Reinventing RNNs for the Transformer Era
- ▶ 4:30 unnamed speaker Yeah, ok so, and, and, ah, just to, and because I had this initial confusion, Brain.js, ah, has nothing to do with TensorFlow, even though I think both were run by Google? 2 times in the scene
- ▶ 6:21 Eugene Cheah And, fast forward, so we build a product around it, where you can automate your browser using low-code, just go there, type simple command, go to Google, click on this text, run.
FlashAttention-2: Making Transformers 800% faster AND exact
- ▶ 8:55 Tri Dao I think there was a paper from NVIDIA folks back in 20, um, 18 about this, and then there was a paper from, um, Google, so, um,
- ▶ 28:10 Tri Dao Um, to what we're doing in academia so that we, we understand where the field is, is moving because, you know, some of the directions are very much the, uh, influenced by what, for example, OpenAI or Google is doing, right?
- ▶ 53:38 Tri Dao Um, so I think on more practical term, it's kind of shifting the balance between kind of closed source model, like OpenAI and, and, and Anthropic and Google, where you're making API calls, right?
Ep 18: Petaflops to the People — with George Hotz of tinycorp
- ▶ 5:21 George Hotz But what you, what's unique about Google is that they also wrote their own ML framework, right? 4 times in the scene
- ▶ 12:23 George Hotz Um, someone at Google knows maybe. 3 times in the scene
- ▶ 20:12 George Hotz NVIDIA GUI tool to convert it into a Chrome trace and then loading.
- ▶ 1:14:33 George Hotz Google TPUs were actually the ultimate. 2 times in the scene