Google TPU

product on 19 shows · 11 statements across 10 episodes · said 528 times in 180 episodes since 2019

TBPN 56 Invest Like the Best 36 the a16z Podcast 33 BG2 Pod 25 Big Technology 24 Latent Space 21 20VC 16 All-In 15 the MAD Podcast 14 Acquired 10 No Priors 7 Cheeky Pint 3 Catalyst 3 the Y Combinator Startup Podcast 2 the Knowledge Project 1 My First Million 1 the Official SaaStr Podcast 1 Sourcery 1 David Senra

Mentions by year, every show

tap a year for its mentions
0075251505020192020202120222023202420252026episodesmentions
0255020192020202120222023202420252026episodes it came up in
0022545020192020202120222023202420252026episodesmentions per episode

TBPN 56Invest Like the Best 36the a16z Podcast 33BG2 Pod 25Big Technology 24Latent Space 2120VC 16All-In 1510 more shows

2026 87 mentions in 41 episodes 2 per episode
2025 118 mentions in 42 episodes 3 per episode
2024 41 mentions in 12 episodes 3 per episode
2023 18 mentions in 5 episodes 4 per episode
2022 4 mentions in 1 episode
2019 1 mention in 1 episode

every mention on every show, scene by scene, with the transcript →

10 statements about Google TPU, every show

DAVID SENRA Assertion Supported
Ross: Porting AlphaGo to TPUs jumped its ELO by hundreds of points
“AlphaGo running on GPUs had an ELO score of about 3200. Lease it all was about 35, 35 50. And I might be getting the first digit wrong. It might be 2000 instead of 3000. But like, you know, it was more than 200. And then when put on on TPUs, it actually went t…”
Jonathan Ross Jul 5, 2026 ▶ 31:00 Why Asking the Right Questions Is the Most Important Skill in the AI Age
INVEST LIKE THE BEST Assertion Partly supported
Sacerdote: Celestica was the sole supplier for Google's TPU servers
“Celestica's heritage was IBM supercomputing, and they kept all that talent and skill, and then we noticed they were the sole supplier of the Google TPU server”
Alex Sacerdote Jun 9, 2026 ▶ 51:29 Why the AI Boom Is Just Getting Started · Invest Like The Best
KNOWLEDGE PROJECT Assertion Supported
Harik: Current Nvidia and Google chips offer 5M times 1990s compute
“You look at today where the latest Google TPUs and where the Nvidia chipsets are at, we're talking five petaflops. That effectively is five million times more powerful from a compute perspective, what existed two to three decades ago.”
Mario Harik Apr 14, 2026 ▶ 1:31:35 The Magic of Thinking Big | XPO CEO Mario Harik
Pope: Google's decision to build TPUs specifically for neural nets paid off
“They at least had the option, like the opportunity to design the TPUs for neural nets at least rather than graphics applications like NVIDIA. And so the overall architecture starting with single core doing what was at the time reasonably large systolic arrays …”
Reiner Pope Feb 26, 2026 ▶ 1:10 Reiner Pope of MatX on accelerating AI with transformer-optimized chips
BG2 Prediction Open · timeframe Sep 2030
Huang: Google TPUs will inevitably transition to customer-owned tooling at scale
“Where will TPUs go when they, when it becomes a large business? Customer-owned tooling. There's no question about it.”
Jensen Huang Sep 26, 2025 ▶ 47:21 NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner · Bg2 Pod
20VC Assertion Supported
Gomez: Google TPUs are now viable for super large-scale AI training
“You can definitely train big models on TPUs. Those are actually now a usable platform for super large scale model training, and I think Google has proven that quite convincingly.”
Aidan Gomez Aug 19, 2024 ▶ 18:10 Aidan Gomez: What No One Understands About Foundation Models | E1191 · 20VC with Harry Stebbings
BIG TECHNOLOGY Disclosure
Clark: Anthropic builds on Amazon Trainium, Google TPU, and Nvidia chips
“I can't get too much into the specifics, but I can just say we've sort of publicly stated that we're Working on both Tranium chips and also TPU chips. We also work on NVIDIA chips as well.”
Jack Clark May 9, 2024 ▶ 38:29 Anthropic's Co-Founder on AI Agents, General Intelligence, and Sentience — With Jack Clark
Hotz: Google TPUs are the only successful non-Nvidia training chips
“The only company, there's one other company aside from Nvidia who's succeeded at all at making training chips... Mid journey is trained on TPU, right? Like a lot of startups do actually train on TPUs, and they're the only other successful training chip aside f…”
George Hotz Jun 20, 2023 ▶ 4:33 Ep 18: Petaflops to the People — with George Hotz of tinycorp
Hotz: Systolic arrays are the wrong architectural choice for AI chips
“I think systolic arrays are the wrong choice. Systolic array, I think they have systolic arrays because that was the guy's PhD. And of course Amazon makes... They are very power efficient, but it becomes hard to schedule a lot of stuff. On them, if you're not …”
George Hotz Jun 20, 2023 ▶ 9:12 Ep 18: Petaflops to the People — with George Hotz of tinycorp
20VC Assertion Not checkable as stated
Mostaque: Stability AI sees zero failure rate training on Google TPUs
“TPUs are the most scalable architecture, like we have zero failure rate with our TPU language model training, whereas with GPUs it's like there's an ECC error”
Emad Mostaque May 17, 2023 ▶ 10:53 Emad Mostaque: These 5 Companies Will Win the AI War; Why We Need National Data Sets | E1015 · 20VC with Harry Stebbings

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.