Tensor Processing Unit, every mention
16 scenes · ← back to Tensor Processing Unit
tap a year for its mentions
every year anyone Shawn Wang 20Alessio Fanelli 10Dylan Patel 7Jeremy Howard 3Yi Tay 1Marc Andreessen 1Jeff Dean 1David Luan 1Arush Sehgal 1
Verbatim, from the transcripts: the passages where Tensor Processing Unit comes up
Marc Andreessen introspects on Death of the Browser, Pi + OpenClaw, and Why "This Time Is Different"
- ▶ 23:40 Marc Andreessen Well, the chip, and then my understanding is Google is running, I don't think, I don't know exactly what, these are rumors that I've heard, or maybe it's public, but I think Google's running very old TPUs and very profitably.
Dylan Patel Explains the AI War While Cooking | In-Context Cooking
- ▶ 49:51 Dylan Patel And, and so now we've entered an age in, especially in 26, but as we go into 27, 28, um, you know, when we look in 26, Google would buy a lot more TPUs, but they can't ramp production fast enough, right? 2 times in the scene
Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis
- ▶ 1:34:05 Shawn Wang I wanted to touch on TPUs and then go into memory. 18 times in the scene
The AI Frontier: from Gemini 3 Deep Think distilling to Flash — Jeff Dean
- ▶ 1:46 Alessio Fanelli And I think initially when you work on the TPU, you were thinking about, you know, if everybody that use Google, we use the voice model for like three minutes a day, they were like, you need to double your CPU number.
- ▶ 1:00:50 Jeff Dean You know, I think combining a lot of those techniques and really just trying to push on scaling things up over the last, you know, 15 years has been, you know, really important, and that means, you know, improvements in the hardware, so,…
Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
- ▶ 54:09 unnamed speaker So then this is very related to NVIDIA's recent purchase of GroK, which I don't know if you have views because you're very TPU centric, but are we memory or compute bound?
Why is everyone cloning Deep Research?
- ▶ 51:20 Arush Sehgal Like, um, I used to work on the MLPerf benchmarks and like, that was like, yeah, you'd put like a bunch of engineers in a room and in a few days they do like amazing performance improvements on, on our TPU stack and things like that.
2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
- ▶ 22:12 Shawn Wang TPU is great. 2 times in the scene
[Paper Club] BERT: Bidirectional Encoder Representations from Transformers
- ▶ 43:33 unnamed speaker Um, does TPUs not have the, the divisible by 64, uh, batch, I mean, like, 3 times in the scene
The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Why Google failed to make GPT-3 -- with David Luan of Adept
- ▶ 8:40 David Luan Like, here's half of all of our TPUs.
Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
- ▶ 10:35 unnamed speaker He mentioned when he was at Google, TensorFlow, it's trying to be optimized to make TPUs go brr, you know, and go as fast. 2 times in the scene
The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis
- ▶ 3:22 Dylan Patel Like, if you think about the cost to rent out, uh, SSD space, so the cost to rent, you know, offer database service on top of that, obviously, uh, cost to rent out a certain level of CPU performance, um, Amazon has a massive advantage…
- ▶ 21:41 Dylan Patel Uh, so the TPUs, uh, so, so the Google TPU is, like, super interesting because Google's been working with Broadcom, who's the number one networking company in the world, right? 4 times in the scene
The End of Finetuning — with Jeremy Howard of Fast.ai
- ▶ 33:57 Jeremy Howard So Google had just released their TPUs, and so I heard from my friends at Google that they had put together this big team to, to smash Dawn Bench so that they could prove to people that they had to use Google Cloud and use their TPUs and… 3 times in the scene
Ep 18: Petaflops to the People — with George Hotz of tinycorp
- ▶ 5:09 Alessio Fanelli Oh, TPU. 9 times in the scene