Oct 6, 2025 · 4h 6m · acquired

Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired

Ben Gilbert · 1h 51m spoken David Rosenthal · 1h 47m spoken
0:00 / 0:00
▶ Watch on YouTube →

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

In this comprehensive retrospective, Acquired hosts Ben Gilbert and David Rosenthal analyze Google's multi-decade evolution into an artificial intelligence powerhouse, examining its breakthrough technical achievements, high-stakes talent wars, and custom silicon infrastructure. They evaluate how Google confronts the classic Innovator's Dilemma as it deploys frontier AI across its core search monopoly and autonomous driving ventures to defend its market dominance.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Ben and David hold 99.8% of the talking time here. How this is scored →

Ben and David as informed peer 7.5 Guest teaching 1.0 Guest disagreement 0.0 Ben and David pushing back 0.0
05100:0020:0040:001:00:001:20:001:40:002:00:002:20:002:40:003:00:003:20:003:40:004:00:000:00–9:50 · Ben and David as informed peer 7/10 Pre-Show Banter and the Acquired Theme Song Ben and David set the stage with deep context about the Innovator's Dilemma facing Google and outline the historic AI roster that passed through the company.9:50–18:24 · Ben and David as informed peer 7/10 Phil, Spelling Correction, and AdSense Launch David details Georges Harik and Noam Shazeer's early work on probabilistic language models, compression, spelling correction, and Phil powering AdSense.18:25–30:34 · Ben and David as informed peer 8/10 Google Translate and Jeff Dean's Parallelization David narrates Franz Och's DARPA machine translation model and Jeff Dean's parallelization work reducing translation latency from 12 hours to 100ms.30:34–37:26 · Ben and David as informed peer 7/10 Geoffrey Hinton and the Dawn of Deep Learning Discussion covers Geoffrey Hinton's arrival at Google via Sebastian Thrun and the contrarian resurgence of deep neural networks.37:27–47:11 · Ben and David as informed peer 8/10 Google Brain, DistBelief, and the Cat Paper Ben and David recount the founding of Google Brain with Andrew Ng and Jeff Dean, DistBelief's asynchronous architecture, and the famous Cat Paper.47:11–59:54 · Ben and David as informed peer 8/10 AlexNet: The Big Bang Moment for Modern AI Ben surprises David with the four-way bidding auction for DNN Research running out of a Lake Tahoe casino room.59:54–1:14:07 · Ben and David as informed peer 7/10 DeepMind's Genesis and Pitching Peter Thiel The hosts detail Demis Hassabis's background, Shane Legg's early AGI focus, pitching Peter Thiel via chess, and Elon Musk's early investment.1:14:07–1:24:49 · Ben and David as informed peer 8/10 Google's $550 Million Acquisition of DeepMind Detailed storytelling on the competitive bidding for DeepMind, Larry Page's private jet kinship, and Alan Eustace's harness rig for Geoffrey Hinton.1:24:49–1:30:44 · Ben and David as informed peer 7/10 DeepMind's Early Google Triumphs: Data Centers and AlphaGo Exploration of early DeepMind wins inside Google, including 40% data center cooling reductions and AlphaGo's victory over Lee Sedol.1:30:45–1:40:22 · Ben and David as informed peer 7/10 The Rosewood Dinner and OpenAI's Inception The fateful Rosewood dinner where Musk and Altman pitched Google AI researchers to form an open non-profit lab, leading to Ilya Sutskever joining.1:40:22–1:51:13 · Ben and David as informed peer 8/10 Custom Silicon: The Genesis of Google's TPU Ben outlines Google's massive initial 40k GPU order, the calculation by Jeff Dean driving the TPU custom ASIC, and reduced precision math.1:51:13–2:03:49 · Ben and David as informed peer 8/10 The Transformer Paper: Attention Is All You Need David and Ben discuss the origins of the Transformer paper, Jakob Uszkoreit's attention concept, Noam Shazeer's code rewrite, and Rich Sutton's Bitter Lesson.2:03:49–2:13:20 · Ben and David as informed peer 7/10 Musk's Exit, GPT-1, and Microsoft's $1B Deal Analysis of Musk's ultimatum to OpenAI, Reid Hoffman connecting Altman to Satya Nadella at Sun Valley, and the creation of OpenAI LP.2:13:21–2:20:24 · Ben and David as informed peer 2/10 Sponsor: Shopify Global Commerce Solutions Sponsor read and interview promo covering Shopify and the transition into GPT-2 and GPT-3 era.2:20:24–2:28:18 · Ben and David as informed peer 8/10 Internal Google Chatbots and ChatGPT's Arrival Detailed breakdown of Google's internal Meena/LaMDA chatbots, why Google hesitated to deploy conversational search, and the runaway launch of ChatGPT.2:28:18–2:34:16 · Ben and David as informed peer 7/10 Code Red and Microsoft's Search Challenge Sundar Pichai declares Code Red as Satya Nadella tries to make Google dance with AI-powered Bing search.2:34:16–2:46:54 · Ben and David as informed peer 8/10 Unifying Brain and DeepMind for Gemini The stumble with Bard's demo error, followed by Pichai's decisive restructuring to merge Google Brain and DeepMind under Demis Hassabis to build Gemini.2:46:54–2:59:03 · Ben and David as informed peer 8/10 Origins of Autonomous Driving at the DARPA Grand Challenge Ben details the 2004/2005 DARPA Grand Challenge, Sebastian Thrun's Stanford software-led approach, and the Larry 1000 driving challenge.2:59:04–3:08:16 · Ben and David as informed peer 8/10 Autonomous Ride-Hailing in Practice: User Experience and Safety Data Analysis of Waymo's safety statistics showing a 91% crash reduction, consumer trust compared to Tesla FSD, and the addressable market size.3:08:17–3:20:42 · Ben and David as informed peer 8/10 Consolidating Google AI: Sundar Pichai Merges Brain and DeepMind Examination of Gemini's rapid iteration speed, 1M context window, Sergey Brin returning to code, and Noam Shazeer's $2.7B return to Google.3:20:43–3:32:31 · Ben and David as informed peer 8/10 The History and Strategic AI Ascent of Google Cloud Platform The strategic evolution of Google Cloud Platform under Thomas Kurian, reaching $50B run rate and serving as the primary TPU distribution engine.3:32:32–3:43:11 · Ben and David as informed peer 9/10 The Bull Case for Google AI: Token Economics, Data Assets, and YouTube Ben and David deliver the Bull Case: lowest-cost token production via TPUs and custom fiber, YouTube multi-modal data moat, and massive query volume.3:43:12–3:51:57 · Ben and David as informed peer 8/10 The Bear Case for Google AI: Monetization Headwinds and Query Siphoning The Bear Case explores high-value commercial search query siphoning, monetization friction in conversational UIs, and shifting market share dynamics.3:51:57–4:02:34 · Ben and David as informed peer 9/10 Quintessence: The Ultimate Innovator's Dilemma Synthesizing Google's Seven Powers and ultimate Innovator's Dilemma of balancing 90% search margins against mission-driven AI dominance.0:00–9:50 · Guest teaching 1/10 Pre-Show Banter and the Acquired Theme Song Ben and David set the stage with deep context about the Innovator's Dilemma facing Google and outline the historic AI roster that passed through the company.9:50–18:24 · Guest teaching 1/10 Phil, Spelling Correction, and AdSense Launch David details Georges Harik and Noam Shazeer's early work on probabilistic language models, compression, spelling correction, and Phil powering AdSense.18:25–30:34 · Guest teaching 1/10 Google Translate and Jeff Dean's Parallelization David narrates Franz Och's DARPA machine translation model and Jeff Dean's parallelization work reducing translation latency from 12 hours to 100ms.30:34–37:26 · Guest teaching 1/10 Geoffrey Hinton and the Dawn of Deep Learning Discussion covers Geoffrey Hinton's arrival at Google via Sebastian Thrun and the contrarian resurgence of deep neural networks.37:27–47:11 · Guest teaching 1/10 Google Brain, DistBelief, and the Cat Paper Ben and David recount the founding of Google Brain with Andrew Ng and Jeff Dean, DistBelief's asynchronous architecture, and the famous Cat Paper.47:11–59:54 · Guest teaching 1/10 AlexNet: The Big Bang Moment for Modern AI Ben surprises David with the four-way bidding auction for DNN Research running out of a Lake Tahoe casino room.59:54–1:14:07 · Guest teaching 1/10 DeepMind's Genesis and Pitching Peter Thiel The hosts detail Demis Hassabis's background, Shane Legg's early AGI focus, pitching Peter Thiel via chess, and Elon Musk's early investment.1:14:07–1:24:49 · Guest teaching 1/10 Google's $550 Million Acquisition of DeepMind Detailed storytelling on the competitive bidding for DeepMind, Larry Page's private jet kinship, and Alan Eustace's harness rig for Geoffrey Hinton.1:24:49–1:30:44 · Guest teaching 1/10 DeepMind's Early Google Triumphs: Data Centers and AlphaGo Exploration of early DeepMind wins inside Google, including 40% data center cooling reductions and AlphaGo's victory over Lee Sedol.1:30:45–1:40:22 · Guest teaching 1/10 The Rosewood Dinner and OpenAI's Inception The fateful Rosewood dinner where Musk and Altman pitched Google AI researchers to form an open non-profit lab, leading to Ilya Sutskever joining.1:40:22–1:51:13 · Guest teaching 1/10 Custom Silicon: The Genesis of Google's TPU Ben outlines Google's massive initial 40k GPU order, the calculation by Jeff Dean driving the TPU custom ASIC, and reduced precision math.1:51:13–2:03:49 · Guest teaching 1/10 The Transformer Paper: Attention Is All You Need David and Ben discuss the origins of the Transformer paper, Jakob Uszkoreit's attention concept, Noam Shazeer's code rewrite, and Rich Sutton's Bitter Lesson.2:03:49–2:13:20 · Guest teaching 1/10 Musk's Exit, GPT-1, and Microsoft's $1B Deal Analysis of Musk's ultimatum to OpenAI, Reid Hoffman connecting Altman to Satya Nadella at Sun Valley, and the creation of OpenAI LP.2:13:21–2:20:24 · Guest teaching 0/10 Sponsor: Shopify Global Commerce Solutions Sponsor read and interview promo covering Shopify and the transition into GPT-2 and GPT-3 era.2:20:24–2:28:18 · Guest teaching 1/10 Internal Google Chatbots and ChatGPT's Arrival Detailed breakdown of Google's internal Meena/LaMDA chatbots, why Google hesitated to deploy conversational search, and the runaway launch of ChatGPT.2:28:18–2:34:16 · Guest teaching 1/10 Code Red and Microsoft's Search Challenge Sundar Pichai declares Code Red as Satya Nadella tries to make Google dance with AI-powered Bing search.2:34:16–2:46:54 · Guest teaching 1/10 Unifying Brain and DeepMind for Gemini The stumble with Bard's demo error, followed by Pichai's decisive restructuring to merge Google Brain and DeepMind under Demis Hassabis to build Gemini.2:46:54–2:59:03 · Guest teaching 1/10 Origins of Autonomous Driving at the DARPA Grand Challenge Ben details the 2004/2005 DARPA Grand Challenge, Sebastian Thrun's Stanford software-led approach, and the Larry 1000 driving challenge.2:59:04–3:08:16 · Guest teaching 1/10 Autonomous Ride-Hailing in Practice: User Experience and Safety Data Analysis of Waymo's safety statistics showing a 91% crash reduction, consumer trust compared to Tesla FSD, and the addressable market size.3:08:17–3:20:42 · Guest teaching 1/10 Consolidating Google AI: Sundar Pichai Merges Brain and DeepMind Examination of Gemini's rapid iteration speed, 1M context window, Sergey Brin returning to code, and Noam Shazeer's $2.7B return to Google.3:20:43–3:32:31 · Guest teaching 1/10 The History and Strategic AI Ascent of Google Cloud Platform The strategic evolution of Google Cloud Platform under Thomas Kurian, reaching $50B run rate and serving as the primary TPU distribution engine.3:32:32–3:43:11 · Guest teaching 1/10 The Bull Case for Google AI: Token Economics, Data Assets, and YouTube Ben and David deliver the Bull Case: lowest-cost token production via TPUs and custom fiber, YouTube multi-modal data moat, and massive query volume.3:43:12–3:51:57 · Guest teaching 1/10 The Bear Case for Google AI: Monetization Headwinds and Query Siphoning The Bear Case explores high-value commercial search query siphoning, monetization friction in conversational UIs, and shifting market share dynamics.3:51:57–4:02:34 · Guest teaching 1/10 Quintessence: The Ultimate Innovator's Dilemma Synthesizing Google's Seven Powers and ultimate Innovator's Dilemma of balancing 90% search margins against mission-driven AI dominance.0:00–9:50 · Guest disagreement 0/10 Pre-Show Banter and the Acquired Theme Song Ben and David set the stage with deep context about the Innovator's Dilemma facing Google and outline the historic AI roster that passed through the company.9:50–18:24 · Guest disagreement 0/10 Phil, Spelling Correction, and AdSense Launch David details Georges Harik and Noam Shazeer's early work on probabilistic language models, compression, spelling correction, and Phil powering AdSense.18:25–30:34 · Guest disagreement 0/10 Google Translate and Jeff Dean's Parallelization David narrates Franz Och's DARPA machine translation model and Jeff Dean's parallelization work reducing translation latency from 12 hours to 100ms.30:34–37:26 · Guest disagreement 0/10 Geoffrey Hinton and the Dawn of Deep Learning Discussion covers Geoffrey Hinton's arrival at Google via Sebastian Thrun and the contrarian resurgence of deep neural networks.37:27–47:11 · Guest disagreement 0/10 Google Brain, DistBelief, and the Cat Paper Ben and David recount the founding of Google Brain with Andrew Ng and Jeff Dean, DistBelief's asynchronous architecture, and the famous Cat Paper.47:11–59:54 · Guest disagreement 0/10 AlexNet: The Big Bang Moment for Modern AI Ben surprises David with the four-way bidding auction for DNN Research running out of a Lake Tahoe casino room.59:54–1:14:07 · Guest disagreement 0/10 DeepMind's Genesis and Pitching Peter Thiel The hosts detail Demis Hassabis's background, Shane Legg's early AGI focus, pitching Peter Thiel via chess, and Elon Musk's early investment.1:14:07–1:24:49 · Guest disagreement 0/10 Google's $550 Million Acquisition of DeepMind Detailed storytelling on the competitive bidding for DeepMind, Larry Page's private jet kinship, and Alan Eustace's harness rig for Geoffrey Hinton.1:24:49–1:30:44 · Guest disagreement 0/10 DeepMind's Early Google Triumphs: Data Centers and AlphaGo Exploration of early DeepMind wins inside Google, including 40% data center cooling reductions and AlphaGo's victory over Lee Sedol.1:30:45–1:40:22 · Guest disagreement 0/10 The Rosewood Dinner and OpenAI's Inception The fateful Rosewood dinner where Musk and Altman pitched Google AI researchers to form an open non-profit lab, leading to Ilya Sutskever joining.1:40:22–1:51:13 · Guest disagreement 0/10 Custom Silicon: The Genesis of Google's TPU Ben outlines Google's massive initial 40k GPU order, the calculation by Jeff Dean driving the TPU custom ASIC, and reduced precision math.1:51:13–2:03:49 · Guest disagreement 0/10 The Transformer Paper: Attention Is All You Need David and Ben discuss the origins of the Transformer paper, Jakob Uszkoreit's attention concept, Noam Shazeer's code rewrite, and Rich Sutton's Bitter Lesson.2:03:49–2:13:20 · Guest disagreement 0/10 Musk's Exit, GPT-1, and Microsoft's $1B Deal Analysis of Musk's ultimatum to OpenAI, Reid Hoffman connecting Altman to Satya Nadella at Sun Valley, and the creation of OpenAI LP.2:13:21–2:20:24 · Guest disagreement 0/10 Sponsor: Shopify Global Commerce Solutions Sponsor read and interview promo covering Shopify and the transition into GPT-2 and GPT-3 era.2:20:24–2:28:18 · Guest disagreement 0/10 Internal Google Chatbots and ChatGPT's Arrival Detailed breakdown of Google's internal Meena/LaMDA chatbots, why Google hesitated to deploy conversational search, and the runaway launch of ChatGPT.2:28:18–2:34:16 · Guest disagreement 0/10 Code Red and Microsoft's Search Challenge Sundar Pichai declares Code Red as Satya Nadella tries to make Google dance with AI-powered Bing search.2:34:16–2:46:54 · Guest disagreement 0/10 Unifying Brain and DeepMind for Gemini The stumble with Bard's demo error, followed by Pichai's decisive restructuring to merge Google Brain and DeepMind under Demis Hassabis to build Gemini.2:46:54–2:59:03 · Guest disagreement 0/10 Origins of Autonomous Driving at the DARPA Grand Challenge Ben details the 2004/2005 DARPA Grand Challenge, Sebastian Thrun's Stanford software-led approach, and the Larry 1000 driving challenge.2:59:04–3:08:16 · Guest disagreement 0/10 Autonomous Ride-Hailing in Practice: User Experience and Safety Data Analysis of Waymo's safety statistics showing a 91% crash reduction, consumer trust compared to Tesla FSD, and the addressable market size.3:08:17–3:20:42 · Guest disagreement 0/10 Consolidating Google AI: Sundar Pichai Merges Brain and DeepMind Examination of Gemini's rapid iteration speed, 1M context window, Sergey Brin returning to code, and Noam Shazeer's $2.7B return to Google.3:20:43–3:32:31 · Guest disagreement 0/10 The History and Strategic AI Ascent of Google Cloud Platform The strategic evolution of Google Cloud Platform under Thomas Kurian, reaching $50B run rate and serving as the primary TPU distribution engine.3:32:32–3:43:11 · Guest disagreement 0/10 The Bull Case for Google AI: Token Economics, Data Assets, and YouTube Ben and David deliver the Bull Case: lowest-cost token production via TPUs and custom fiber, YouTube multi-modal data moat, and massive query volume.3:43:12–3:51:57 · Guest disagreement 0/10 The Bear Case for Google AI: Monetization Headwinds and Query Siphoning The Bear Case explores high-value commercial search query siphoning, monetization friction in conversational UIs, and shifting market share dynamics.3:51:57–4:02:34 · Guest disagreement 0/10 Quintessence: The Ultimate Innovator's Dilemma Synthesizing Google's Seven Powers and ultimate Innovator's Dilemma of balancing 90% search margins against mission-driven AI dominance.0:00–9:50 · Ben and David pushing back 0/10 Pre-Show Banter and the Acquired Theme Song Ben and David set the stage with deep context about the Innovator's Dilemma facing Google and outline the historic AI roster that passed through the company.9:50–18:24 · Ben and David pushing back 0/10 Phil, Spelling Correction, and AdSense Launch David details Georges Harik and Noam Shazeer's early work on probabilistic language models, compression, spelling correction, and Phil powering AdSense.18:25–30:34 · Ben and David pushing back 0/10 Google Translate and Jeff Dean's Parallelization David narrates Franz Och's DARPA machine translation model and Jeff Dean's parallelization work reducing translation latency from 12 hours to 100ms.30:34–37:26 · Ben and David pushing back 0/10 Geoffrey Hinton and the Dawn of Deep Learning Discussion covers Geoffrey Hinton's arrival at Google via Sebastian Thrun and the contrarian resurgence of deep neural networks.37:27–47:11 · Ben and David pushing back 0/10 Google Brain, DistBelief, and the Cat Paper Ben and David recount the founding of Google Brain with Andrew Ng and Jeff Dean, DistBelief's asynchronous architecture, and the famous Cat Paper.47:11–59:54 · Ben and David pushing back 0/10 AlexNet: The Big Bang Moment for Modern AI Ben surprises David with the four-way bidding auction for DNN Research running out of a Lake Tahoe casino room.59:54–1:14:07 · Ben and David pushing back 0/10 DeepMind's Genesis and Pitching Peter Thiel The hosts detail Demis Hassabis's background, Shane Legg's early AGI focus, pitching Peter Thiel via chess, and Elon Musk's early investment.1:14:07–1:24:49 · Ben and David pushing back 0/10 Google's $550 Million Acquisition of DeepMind Detailed storytelling on the competitive bidding for DeepMind, Larry Page's private jet kinship, and Alan Eustace's harness rig for Geoffrey Hinton.1:24:49–1:30:44 · Ben and David pushing back 0/10 DeepMind's Early Google Triumphs: Data Centers and AlphaGo Exploration of early DeepMind wins inside Google, including 40% data center cooling reductions and AlphaGo's victory over Lee Sedol.1:30:45–1:40:22 · Ben and David pushing back 0/10 The Rosewood Dinner and OpenAI's Inception The fateful Rosewood dinner where Musk and Altman pitched Google AI researchers to form an open non-profit lab, leading to Ilya Sutskever joining.1:40:22–1:51:13 · Ben and David pushing back 0/10 Custom Silicon: The Genesis of Google's TPU Ben outlines Google's massive initial 40k GPU order, the calculation by Jeff Dean driving the TPU custom ASIC, and reduced precision math.1:51:13–2:03:49 · Ben and David pushing back 0/10 The Transformer Paper: Attention Is All You Need David and Ben discuss the origins of the Transformer paper, Jakob Uszkoreit's attention concept, Noam Shazeer's code rewrite, and Rich Sutton's Bitter Lesson.2:03:49–2:13:20 · Ben and David pushing back 0/10 Musk's Exit, GPT-1, and Microsoft's $1B Deal Analysis of Musk's ultimatum to OpenAI, Reid Hoffman connecting Altman to Satya Nadella at Sun Valley, and the creation of OpenAI LP.2:13:21–2:20:24 · Ben and David pushing back 0/10 Sponsor: Shopify Global Commerce Solutions Sponsor read and interview promo covering Shopify and the transition into GPT-2 and GPT-3 era.2:20:24–2:28:18 · Ben and David pushing back 0/10 Internal Google Chatbots and ChatGPT's Arrival Detailed breakdown of Google's internal Meena/LaMDA chatbots, why Google hesitated to deploy conversational search, and the runaway launch of ChatGPT.2:28:18–2:34:16 · Ben and David pushing back 0/10 Code Red and Microsoft's Search Challenge Sundar Pichai declares Code Red as Satya Nadella tries to make Google dance with AI-powered Bing search.2:34:16–2:46:54 · Ben and David pushing back 0/10 Unifying Brain and DeepMind for Gemini The stumble with Bard's demo error, followed by Pichai's decisive restructuring to merge Google Brain and DeepMind under Demis Hassabis to build Gemini.2:46:54–2:59:03 · Ben and David pushing back 0/10 Origins of Autonomous Driving at the DARPA Grand Challenge Ben details the 2004/2005 DARPA Grand Challenge, Sebastian Thrun's Stanford software-led approach, and the Larry 1000 driving challenge.2:59:04–3:08:16 · Ben and David pushing back 0/10 Autonomous Ride-Hailing in Practice: User Experience and Safety Data Analysis of Waymo's safety statistics showing a 91% crash reduction, consumer trust compared to Tesla FSD, and the addressable market size.3:08:17–3:20:42 · Ben and David pushing back 0/10 Consolidating Google AI: Sundar Pichai Merges Brain and DeepMind Examination of Gemini's rapid iteration speed, 1M context window, Sergey Brin returning to code, and Noam Shazeer's $2.7B return to Google.3:20:43–3:32:31 · Ben and David pushing back 0/10 The History and Strategic AI Ascent of Google Cloud Platform The strategic evolution of Google Cloud Platform under Thomas Kurian, reaching $50B run rate and serving as the primary TPU distribution engine.3:32:32–3:43:11 · Ben and David pushing back 0/10 The Bull Case for Google AI: Token Economics, Data Assets, and YouTube Ben and David deliver the Bull Case: lowest-cost token production via TPUs and custom fiber, YouTube multi-modal data moat, and massive query volume.3:43:12–3:51:57 · Ben and David pushing back 0/10 The Bear Case for Google AI: Monetization Headwinds and Query Siphoning The Bear Case explores high-value commercial search query siphoning, monetization friction in conversational UIs, and shifting market share dynamics.3:51:57–4:02:34 · Ben and David pushing back 0/10 Quintessence: The Ultimate Innovator's Dilemma Synthesizing Google's Seven Powers and ultimate Innovator's Dilemma of balancing 90% search margins against mission-driven AI dominance.

speaking balance: gold is Ben and David, purple is the guest (3 minute bins)

0:00 · Ben and David 90.8% · guest 9.2%0:00 · Ben and David 90.8% · guest 9.2%3:00 · Ben and David 100% · guest 0%3:00 · Ben and David 100% · guest 0%6:00 · Ben and David 100% · guest 0%6:00 · Ben and David 100% · guest 0%9:00 · Ben and David 100% · guest 0%9:00 · Ben and David 100% · guest 0%12:00 · Ben and David 99.9% · guest 0.1%12:00 · Ben and David 99.9% · guest 0.1%15:00 · Ben and David 100% · guest 0%15:00 · Ben and David 100% · guest 0%18:00 · Ben and David 99.8% · guest 0.2%18:00 · Ben and David 99.8% · guest 0.2%21:00 · Ben and David 100% · guest 0%21:00 · Ben and David 100% · guest 0%24:00 · Ben and David 99.8% · guest 0.2%24:00 · Ben and David 99.8% · guest 0.2%27:00 · Ben and David 100% · guest 0%27:00 · Ben and David 100% · guest 0%30:00 · Ben and David 100% · guest 0%30:00 · Ben and David 100% · guest 0%33:00 · Ben and David 100% · guest 0%33:00 · Ben and David 100% · guest 0%36:00 · Ben and David 99.9% · guest 0.1%36:00 · Ben and David 99.9% · guest 0.1%39:00 · Ben and David 100% · guest 0%39:00 · Ben and David 100% · guest 0%42:00 · Ben and David 99.6% · guest 0.4%42:00 · Ben and David 99.6% · guest 0.4%45:00 · Ben and David 100% · guest 0%45:00 · Ben and David 100% · guest 0%48:00 · Ben and David 100% · guest 0%48:00 · Ben and David 100% · guest 0%51:00 · Ben and David 100% · guest 0%51:00 · Ben and David 100% · guest 0%54:00 · Ben and David 100% · guest 0%54:00 · Ben and David 100% · guest 0%57:00 · Ben and David 100% · guest 0%57:00 · Ben and David 100% · guest 0%1:00:00 · Ben and David 100% · guest 0%1:00:00 · Ben and David 100% · guest 0%1:03:00 · Ben and David 99.8% · guest 0.2%1:03:00 · Ben and David 99.8% · guest 0.2%1:06:00 · Ben and David 99.6% · guest 0.4%1:06:00 · Ben and David 99.6% · guest 0.4%1:09:00 · Ben and David 100% · guest 0%1:09:00 · Ben and David 100% · guest 0%1:12:00 · Ben and David 100% · guest 0%1:12:00 · Ben and David 100% · guest 0%1:15:00 · Ben and David 100% · guest 0%1:15:00 · Ben and David 100% · guest 0%1:18:00 · Ben and David 100% · guest 0%1:18:00 · Ben and David 100% · guest 0%1:21:00 · Ben and David 100% · guest 0%1:21:00 · Ben and David 100% · guest 0%1:24:00 · Ben and David 100% · guest 0%1:24:00 · Ben and David 100% · guest 0%1:27:00 · Ben and David 100% · guest 0%1:27:00 · Ben and David 100% · guest 0%1:30:00 · Ben and David 100% · guest 0%1:30:00 · Ben and David 100% · guest 0%1:33:00 · Ben and David 100% · guest 0%1:33:00 · Ben and David 100% · guest 0%1:36:00 · Ben and David 100% · guest 0%1:36:00 · Ben and David 100% · guest 0%1:39:00 · Ben and David 100% · guest 0%1:39:00 · Ben and David 100% · guest 0%1:42:00 · Ben and David 100% · guest 0%1:42:00 · Ben and David 100% · guest 0%1:45:00 · Ben and David 99.7% · guest 0.3%1:45:00 · Ben and David 99.7% · guest 0.3%1:48:00 · Ben and David 100% · guest 0%1:48:00 · Ben and David 100% · guest 0%1:51:00 · Ben and David 100% · guest 0%1:51:00 · Ben and David 100% · guest 0%1:54:00 · Ben and David 100% · guest 0%1:54:00 · Ben and David 100% · guest 0%1:57:00 · Ben and David 100% · guest 0%1:57:00 · Ben and David 100% · guest 0%2:00:00 · Ben and David 99.8% · guest 0.2%2:00:00 · Ben and David 99.8% · guest 0.2%2:03:00 · Ben and David 100% · guest 0%2:03:00 · Ben and David 100% · guest 0%2:06:00 · Ben and David 100% · guest 0%2:06:00 · Ben and David 100% · guest 0%2:09:00 · Ben and David 100% · guest 0%2:09:00 · Ben and David 100% · guest 0%2:12:00 · Ben and David 99.9% · guest 0.1%2:12:00 · Ben and David 99.9% · guest 0.1%2:15:00 · Ben and David 99.8% · guest 0.2%2:15:00 · Ben and David 99.8% · guest 0.2%2:18:00 · Ben and David 100% · guest 0%2:18:00 · Ben and David 100% · guest 0%2:21:00 · Ben and David 100% · guest 0%2:21:00 · Ben and David 100% · guest 0%2:24:00 · Ben and David 100% · guest 0%2:24:00 · Ben and David 100% · guest 0%2:27:00 · Ben and David 100% · guest 0%2:27:00 · Ben and David 100% · guest 0%2:30:00 · Ben and David 100% · guest 0%2:30:00 · Ben and David 100% · guest 0%2:33:00 · Ben and David 100% · guest 0%2:33:00 · Ben and David 100% · guest 0%2:36:00 · Ben and David 100% · guest 0%2:36:00 · Ben and David 100% · guest 0%2:39:00 · Ben and David 99.9% · guest 0.1%2:39:00 · Ben and David 99.9% · guest 0.1%2:42:00 · Ben and David 100% · guest 0%2:42:00 · Ben and David 100% · guest 0%2:45:00 · Ben and David 100% · guest 0%2:45:00 · Ben and David 100% · guest 0%2:48:00 · Ben and David 99.9% · guest 0.1%2:48:00 · Ben and David 99.9% · guest 0.1%2:51:00 · Ben and David 100% · guest 0%2:51:00 · Ben and David 100% · guest 0%2:54:00 · Ben and David 100% · guest 0%2:54:00 · Ben and David 100% · guest 0%2:57:00 · Ben and David 100% · guest 0%2:57:00 · Ben and David 100% · guest 0%3:00:00 · Ben and David 100% · guest 0%3:00:00 · Ben and David 100% · guest 0%3:03:00 · Ben and David 100% · guest 0%3:03:00 · Ben and David 100% · guest 0%3:06:00 · Ben and David 100% · guest 0%3:06:00 · Ben and David 100% · guest 0%3:09:00 · Ben and David 100% · guest 0%3:09:00 · Ben and David 100% · guest 0%3:12:00 · Ben and David 100% · guest 0%3:12:00 · Ben and David 100% · guest 0%3:15:00 · Ben and David 100% · guest 0%3:15:00 · Ben and David 100% · guest 0%3:18:00 · Ben and David 100% · guest 0%3:18:00 · Ben and David 100% · guest 0%3:21:00 · Ben and David 100% · guest 0%3:21:00 · Ben and David 100% · guest 0%3:24:00 · Ben and David 100% · guest 0%3:24:00 · Ben and David 100% · guest 0%3:27:00 · Ben and David 100% · guest 0%3:27:00 · Ben and David 100% · guest 0%3:30:00 · Ben and David 100% · guest 0%3:30:00 · Ben and David 100% · guest 0%3:33:00 · Ben and David 100% · guest 0%3:33:00 · Ben and David 100% · guest 0%3:36:00 · Ben and David 100% · guest 0%3:36:00 · Ben and David 100% · guest 0%3:39:00 · Ben and David 100% · guest 0%3:39:00 · Ben and David 100% · guest 0%3:42:00 · Ben and David 100% · guest 0%3:42:00 · Ben and David 100% · guest 0%3:45:00 · Ben and David 99.9% · guest 0.1%3:45:00 · Ben and David 99.9% · guest 0.1%3:48:00 · Ben and David 99.8% · guest 0.2%3:48:00 · Ben and David 99.8% · guest 0.2%3:51:00 · Ben and David 100% · guest 0%3:51:00 · Ben and David 100% · guest 0%3:54:00 · Ben and David 99.9% · guest 0.1%3:54:00 · Ben and David 99.9% · guest 0.1%3:57:00 · Ben and David 100% · guest 0%3:57:00 · Ben and David 100% · guest 0%4:00:00 · Ben and David 100% · guest 0%4:00:00 · Ben and David 100% · guest 0%4:03:00 · Ben and David 100% · guest 0%4:03:00 · Ben and David 100% · guest 0%4:06:00 · Ben and David 73.3% · guest 26.7%4:06:00 · Ben and David 73.3% · guest 26.7%
Sharpest disagreement ▶ 2:04:15 Musk's OpenAI Ultimatum

David recounts Elon Musk's aggressive demand to assume total control and merge OpenAI into Tesla or pull all funding.

Hardest push from Ben and David ▶ 2:21:55 Search Ad Disintermediation Pushback

Ben highlights the severe internal business model pushback against replacing 10 blue search links with conversational chatbots.

Biggest teaching moment ▶ 52:48 Ben Reveals the 4-Way Tahoe Auction

Ben schools David on the surprising bidding war for DNN Research between Baidu, Google, Microsoft, and DeepMind inside a casino hotel room.

Ben and David hold their own ▶ 3:37:40 Token Unit Economics Analysis

Ben provides a granular financial breakdown demonstrating how Google's TPU margin advantages make it the low-cost token provider globally.

the scores for every segment, with the reasoning behind each
ChapterTopicBen and David as informed peerGuest teachingGuest disagreementBen and David pushing backWhy
Pre-Show Banter and the Acquired Theme Song 7100 Ben and David set the stage with deep context about the Innovator's Dilemma facing Google and outline the historic AI roster that passed through the company.
Phil, Spelling Correction, and AdSense Launch 7100 David details Georges Harik and Noam Shazeer's early work on probabilistic language models, compression, spelling correction, and Phil powering AdSense.
Google Translate and Jeff Dean's Parallelization 8100 David narrates Franz Och's DARPA machine translation model and Jeff Dean's parallelization work reducing translation latency from 12 hours to 100ms.
Geoffrey Hinton and the Dawn of Deep Learning 7100 Discussion covers Geoffrey Hinton's arrival at Google via Sebastian Thrun and the contrarian resurgence of deep neural networks.
Google Brain, DistBelief, and the Cat Paper 8100 Ben and David recount the founding of Google Brain with Andrew Ng and Jeff Dean, DistBelief's asynchronous architecture, and the famous Cat Paper.
AlexNet: The Big Bang Moment for Modern AI 8100 Ben surprises David with the four-way bidding auction for DNN Research running out of a Lake Tahoe casino room.
DeepMind's Genesis and Pitching Peter Thiel 7100 The hosts detail Demis Hassabis's background, Shane Legg's early AGI focus, pitching Peter Thiel via chess, and Elon Musk's early investment.
Google's $550 Million Acquisition of DeepMind 8100 Detailed storytelling on the competitive bidding for DeepMind, Larry Page's private jet kinship, and Alan Eustace's harness rig for Geoffrey Hinton.
DeepMind's Early Google Triumphs: Data Centers and AlphaGo 7100 Exploration of early DeepMind wins inside Google, including 40% data center cooling reductions and AlphaGo's victory over Lee Sedol.
The Rosewood Dinner and OpenAI's Inception 7100 The fateful Rosewood dinner where Musk and Altman pitched Google AI researchers to form an open non-profit lab, leading to Ilya Sutskever joining.
Custom Silicon: The Genesis of Google's TPU 8100 Ben outlines Google's massive initial 40k GPU order, the calculation by Jeff Dean driving the TPU custom ASIC, and reduced precision math.
The Transformer Paper: Attention Is All You Need 8100 David and Ben discuss the origins of the Transformer paper, Jakob Uszkoreit's attention concept, Noam Shazeer's code rewrite, and Rich Sutton's Bitter Lesson.
Musk's Exit, GPT-1, and Microsoft's $1B Deal 7100 Analysis of Musk's ultimatum to OpenAI, Reid Hoffman connecting Altman to Satya Nadella at Sun Valley, and the creation of OpenAI LP.
Sponsor: Shopify Global Commerce Solutions 2000 Sponsor read and interview promo covering Shopify and the transition into GPT-2 and GPT-3 era.
Internal Google Chatbots and ChatGPT's Arrival 8100 Detailed breakdown of Google's internal Meena/LaMDA chatbots, why Google hesitated to deploy conversational search, and the runaway launch of ChatGPT.
Code Red and Microsoft's Search Challenge 7100 Sundar Pichai declares Code Red as Satya Nadella tries to make Google dance with AI-powered Bing search.
Unifying Brain and DeepMind for Gemini 8100 The stumble with Bard's demo error, followed by Pichai's decisive restructuring to merge Google Brain and DeepMind under Demis Hassabis to build Gemini.
Origins of Autonomous Driving at the DARPA Grand Challenge 8100 Ben details the 2004/2005 DARPA Grand Challenge, Sebastian Thrun's Stanford software-led approach, and the Larry 1000 driving challenge.
Autonomous Ride-Hailing in Practice: User Experience and Safety Data 8100 Analysis of Waymo's safety statistics showing a 91% crash reduction, consumer trust compared to Tesla FSD, and the addressable market size.
Consolidating Google AI: Sundar Pichai Merges Brain and DeepMind 8100 Examination of Gemini's rapid iteration speed, 1M context window, Sergey Brin returning to code, and Noam Shazeer's $2.7B return to Google.
The History and Strategic AI Ascent of Google Cloud Platform 8100 The strategic evolution of Google Cloud Platform under Thomas Kurian, reaching $50B run rate and serving as the primary TPU distribution engine.
The Bull Case for Google AI: Token Economics, Data Assets, and YouTube 9100 Ben and David deliver the Bull Case: lowest-cost token production via TPUs and custom fiber, YouTube multi-modal data moat, and massive query volume.
The Bear Case for Google AI: Monetization Headwinds and Query Siphoning 8100 The Bear Case explores high-value commercial search query siphoning, monetization friction in conversational UIs, and shifting market share dynamics.
Quintessence: The Ultimate Innovator's Dilemma 9100 Synthesizing Google's Seven Powers and ultimate Innovator's Dilemma of balancing 90% search margins against mission-driven AI dominance.

Statements from this episode (95)

Assertion Not checkable as stated
Modern AI Revolution Is Predicated on Google's 2017 Transformer Invention
“The entire AI revolution that we are in right now is predicated by the invention of the transformer out of the Google brain team in 2017.”
Ben Gilbert Oct 6, 2025 ▶ 2:41
Assertion Not checkable as stated
Google TPUs Are Only Scaled AI Chip Deployment Besides Nvidia
“They're a chip company with their Tensor Processing Units, or TPUs, which is the only real scale deployment of AI chips in the world besides Nvidia GPUs.”
Ben Gilbert Oct 6, 2025 ▶ 3:27
Assertion Contradicted
Google Is Only Company with Both Frontier Model and AI Silicon
“Somebody put it to me in research that if you don't have a foundational frontier model, Or you don't have an AI chip, you might just be a commodity in the AI market, and Google is the only company that has both.”
David Rosenthal Oct 6, 2025 ▶ 3:41
Assertion Not checkable as stated
In the Mid-2010s, Nearly Every Prominent AI Researcher Worked at Google
“Basically, every single person of note in AI worked at Google, with the one exception of Yann LeCun, who worked at Facebook.”
David Rosenthal Oct 6, 2025 ▶ 7:17
Assertion Supported
Noam Shazeer Created Google's 'Did You Mean' Spelling Correction
“So the first thing that they do with this work is they create the did you mean spelling correction in Google search. ... Gnome created this.”
David Rosenthal Oct 6, 2025 ▶ 14:15
Assertion Partly supported
Jeff Dean Coded AdSense in One Week Using Early Phil Model
“Jeff Dean borrows Phil and famously uses it to code up his implementation of AdSense in a week, because he's Jeff Dean.”
David Rosenthal Oct 6, 2025 ▶ 16:04
Assertion Not publicly verifiable
Google's Early Phil Model Used 15% of All Data Center Infrastructure
“Phil gets so big that apparently by the mid-two thousands, Phil is using 15% of Google's entire data center infrastructure.”
David Rosenthal Oct 6, 2025 ▶ 17:54
Opinion
Google Is the World Leader in CPU Workload Parallelization
“They are the single best company in the world at parallelizing workloads across CPUs across multiple data centers.”
Ben Gilbert Oct 6, 2025 ▶ 22:29
Assertion Supported
Jeff Dean Cut Google Translate Latency from 12 Hours to 100ms
“And Jeff's work with the team gets that average sentence translation time down from 12 hours to 100 milliseconds.”
David Rosenthal Oct 6, 2025 ▶ 22:39
Assertion Supported
Google Translate Was Google's First Production Language Model
“So this is the first large, I'm using large in quotes here, language model used in production in a product at Google.”
David Rosenthal Oct 6, 2025 ▶ 23:02
Assertion Open · timeframe Oct 2025
Larry Page Pre-empted Benchmark and Sequoia to Acqui-hire Sebastian Thrun
“He and some, I think it was grad students, were in the process of starting a company, had term sheets from Benchmark and Sequoia.”
Ben Gilbert Oct 6, 2025 ▶ 25:08
Assertion Not checkable as stated
Neural Networks Were an Unrespected Subfield of AI in 2007
“At this point in history. I mean, neural networks were not a respected subtree of AI.”
Ben Gilbert Oct 6, 2025 ▶ 30:29
Assertion Supported
Geoffrey Hinton Is the Great-Great-Grandson of George Boole
“He is the great-great-grandson of George and Mary Boole, who invented Boolean algebra and Boolean logic.”
David Rosenthal Oct 6, 2025 ▶ 31:02
Assertion Supported
Geoffrey Hinton Was a Google Summer Intern in His 60s
“He was a summer intern in somewhere around twenty-eleven, twenty-twelve. And mind you, at this point, he's like 60 years old.”
Ben Gilbert Oct 6, 2025 ▶ 34:03
Assertion Supported
Google X Was Formed in Late 2009 by Thrun, Page, and Brin
“Sebastian's concept of bringing these computer science machine learning academics into Google as contractors or part-time interns, basically letting them keep their academic posts and work on big projects for Google's products internally, goes so well that by …”
David Rosenthal Oct 6, 2025 ▶ 34:11
Assertion Supported
Google Brain Trained a 9-Layer Neural Network Using 16,000 CPUs
“What they did was they trained a large nine-layer neural network to recognize cats from unlabeled frames of YouTube videos using 16,000 CPU cores on a thousand different machines.”
Ben Gilbert Oct 6, 2025 ▶ 41:53
Opinion
The 2011 Google Brain 'Cat Paper' Drove Hundreds of Billions in Revenue
“I think it's not that much of a leap to say that the cat paper led to probably hundreds of billions of dollars of revenue generated by Google and Facebook and ByteDance over the next decade.”
David Rosenthal Oct 6, 2025 ▶ 43:12
Assertion Supported
AlexNet Reduced ImageNet Error Rates from 25% to 15% in 2012
“Along comes AlexNet. Its error rate was 15%. Still high, but a 10% leap from the previous best being a 25% error rate all the way down to 15 in one year. A leap like that had never happened before.”
David Rosenthal Oct 6, 2025 ▶ 48:40
Assertion Supported
AlexNet Was Trained on Two Off-the-Shelf Nvidia GTX 580 GPUs
“They buy two NVIDIA GeForce GTX five eighties, which were NVIDIA's top of the line gaming cards at the time. The Toronto team rewrites their neural network algorithms in CUDA, NVIDIA's programming language. They train it on these two off the shelf GTX five eig…”
David Rosenthal Oct 6, 2025 ▶ 50:23
Insight
AI Advances Through Step-Functions Followed by Multi-Year Optimization
“And this is how AI research tends to work, is there's some breakthrough that gets you this big step change function, and then there's actually a multi-year process of optimizing from there, where you get these kind of diminishing returns curves on breakthrough…”
Ben Gilbert Oct 6, 2025 ▶ 51:23
Assertion Supported
Baidu Made an Initial $12M Offer for DNN Research in 2012
“So Baidu offers twelve million dollars.”
Ben Gilbert Oct 6, 2025 ▶ 52:50
Assertion Supported
DeepMind Participated as a Bidder in the 2012 DNN Research Auction
“DeepMind, baby. They are the fourth bidder in a four-way auction for DNN Research.”
Ben Gilbert Oct 6, 2025 ▶ 54:30
Assertion Supported
Google Acquired DNN Research for $44M After Founders Halted Auction
“And so they stop the bidding at forty-four million dollars and just say, Google, This is more than enough money. We're going with you.”
Ben Gilbert Oct 6, 2025 ▶ 55:42
Assertion Partly supported
Astro Teller: Google Brain Gains More Than Funded All Google X Bets
“Astro Teller, who would take over running Google X after Sebastian Thrun left, he would get quoted in the New York Times in a profile of Google X that the gains to Google's core businesses in search and ads and YouTube from Google Brain Have way more than fund…”
David Rosenthal Oct 6, 2025 ▶ 56:25
Opinion
DeepMind Is Among the Greatest Tech Acquisitions Ever
“They bought this thing for, we'll talk about the purchase price, but it's worth, what, five hundred billion dollars today? I mean, this is as good as Instagram or YouTube in terms of greatest acquisitions of all time.”
Ben Gilbert Oct 6, 2025 ▶ 1:00:03
Opinion
Google's DeepMind Buy Directly Spawned Modern AI Labs
“This company and this purchase of it by Google was the butterfly flapping its wings equivalent moment that directly leads to OpenAI, ChatGPT, Anthropic, and basically everything.”
David Rosenthal Oct 6, 2025 ▶ 1:01:36
Assertion Supported
Founders Fund Led DeepMind's ~$2M Seed Financing
“Founders Fund leads DeepMind's seed round of about two million dollars.”
David Rosenthal Oct 6, 2025 ▶ 1:11:10
Assertion Supported
Elon Musk Offered to Buy DeepMind with Tesla Stock in 2013
“He immediately calls up Demis and says, I will buy the company right now with Tesla stock. This is late 2013, like, early 2014. Tesla's market cap is about twenty billion dollars.”
David Rosenthal Oct 6, 2025 ▶ 1:18:26
Opinion
DeepMind Would Be Worth $500 Billion as an Independent Company
“This is an asset that Google owns today that, again, I think is worth half a trillion dollars if it's independent.”
Ben Gilbert Oct 6, 2025 ▶ 1:24:21
Assertion Supported
Google Announced a 40% Reduction in Data Center Cooling Energy in 2016
“Very quickly, July of 20 16, Google announces a 40% reduction in the energy required to cool data centers.”
Ben Gilbert Oct 6, 2025 ▶ 1:25:09
Assertion Supported
AlphaGo Beat Lee Sedol by Winning the First Three Games Straight
“It's a five-game thing. It just won the first three games straight. I mean, completely cleaned up. And with inventive, new, creative moves that no human has played before.”
Ben Gilbert Oct 6, 2025 ▶ 1:26:11
Assertion Supported
Google Doubled Its Offer to Keep Ilya Sutskever Before OpenAI
“Google came back with a big counter, something like double the offer, and I think it was delivered from Jeff Dean personally, and Ilya said, nope, I'm doing this.”
Ben Gilbert Oct 6, 2025 ▶ 1:35:31
Assertion Supported
OpenAI Only Collected $130M of Its Initial $1B Pledge
“The funny thing is, it was later reported that a billion dollars was not actually collected. Only about a hundred and thirty million of it was actually collected to fund this nonprofit.”
Ben Gilbert Oct 6, 2025 ▶ 1:37:04
Opinion
Elon Musk Deserves Credit for Early OpenAI Researcher Recruiting
“And I think Elon deserves a lot of credit for having his name and his time attached to OpenA at the beginning. A lot of the big heavy hitter recruiting was Elon throwing his weight behind this.”
Ben Gilbert Oct 6, 2025 ▶ 1:39:54
Assertion Supported
Larry Page Personally Approved $130M Nvidia GPU Order in 2014
“So they settle on a plan to order 40,000 GPUs. From Nvidia. For a cost of a hundred and thirty million dollars. That's a big enough price tag that the request gets elevated to Larry Page, who personally approves it, even though finance wanted to kill it, becau…”
Ben Gilbert Oct 6, 2025 ▶ 1:42:12
Assertion Supported
Google Designed and Deployed First TPU in 15 Months
“So, the TPU was designed, verified, built, and deployed into data centers in 15 months.”
Ben Gilbert Oct 6, 2025 ▶ 1:47:49
Assertion Supported
Google Operates an Estimated 2 to 3 Million Custom TPUs
“But today, Google, it's estimated, has two to three million TPUs. For reference, Nvidia shipped, people don't know for sure, somewhere around four million GPUs last year.”
Ben Gilbert Oct 6, 2025 ▶ 1:49:49
Assertion Supported
Incorporating LSTMs Cut Google Translate Error Rate by 60%
“And indeed, in 2016, they incorporated into Google Translate these LSTMs. It reduces the error rate by 60%.”
David Rosenthal Oct 6, 2025 ▶ 1:54:58
Assertion Supported
'Attention Is All You Need' Is the 21st Century's 7th Most-Cited Paper
“As of today, in 2025, this paper has been cited Over a 173,000 times in other academic papers, making it currently the seventh most cited paper of the 21st century.”
David Rosenthal Oct 6, 2025 ▶ 2:02:44
Assertion Open · timeframe Oct 2025
All Eight Transformer Paper Co-Authors Left Google Within Years
“And also, of course, within a couple years, all eight authors of the Transformer paper had left Google to either start or join AI startups, including OpenAI.”
David Rosenthal Oct 6, 2025 ▶ 2:03:08
Opinion
2017 Began a 5-Year Period of Google Failing on Transformers
“It is fair to say that 2017 begins the five-year period of Google not sufficiently seizing the opportunity that they had created.”
Ben Gilbert Oct 6, 2025 ▶ 2:03:40
Assertion Supported
OpenAI Introduced Pre-trained Transformers with GPT-1 in June 2018
“So in June of 2018, OpenAI releases a paper describing how they have taken the transformer and developed a new approach of pre-training them on very large amounts of general text on the internet, and then fine tuning that general pre-training to specific use c…”
David Rosenthal Oct 6, 2025 ▶ 2:07:33
Assertion Partly supported
Microsoft's $1B Deal Spurred OpenAI's Captive For-Profit Restructuring
“And while they're there, they hash out a deal for Microsoft to invest one billion dollars into OpenAI in a combination of both cash and Azure cloud credits. And in return, Microsoft will get access to OpenAI's technology, get an exclusive license to OpenAI's t…”
David Rosenthal Oct 6, 2025 ▶ 2:09:27
Assertion Supported
Microsoft Invested an Additional $2B in OpenAI in 2021
“So after that, Microsoft invests another two billion dollars in OpenAI, which seemed like a lot of money at the time.”
David Rosenthal Oct 6, 2025 ▶ 2:18:35
Assertion Partly supported
Google Suffered a Nearly 50% Drawdown After November 2021
“The high watermark was November, 19th of 20 21. Google was right at two trillion dollars of market cap. About a year after that slide began, they were worth a trillion dollars. Nearly a 50% drawdown.”
Ben Gilbert Oct 6, 2025 ▶ 2:19:07
Assertion Supported
Noam Shazeer Urged Google Leadership to Replace Search with Transformer Models
“Gnome, though, immediately starts advocating to Google leadership. Hey, I think this is going to be so big, the transformer, that we should actually consider just throwing out the search index And the 10 blue links model and go all in on transforming all of Go…”
David Rosenthal Oct 6, 2025 ▶ 2:21:29
Assertion Supported
OpenAI Originally Planned to Be a B2B API Business Before ChatGPT
“They also just throw up a paywall randomly because they thought that the business was going to be an API business. They thought that the projections were all about how much revenue they were going to do through B to B licensing deals. And then they just realiz…”
Ben Gilbert Oct 6, 2025 ▶ 2:26:39
Assertion Supported
OpenAI Rushed ChatGPT Launch After Learning of Anthropic's Chatbot Plans
“So, Anthropic was working on what would become Claude, and rumors were out there, and people at OpenAI Got wind of like, oh, hey, Anthropic and Dario are working on a chat interface. We should probably do one too. And if we're gonna do one, we should probably …”
David Rosenthal Oct 6, 2025 ▶ 2:27:48
Assertion Supported
Google Paid $2.7B to License Character.AI and Rehire Noam Shazeer
“Google ultimately in twenty-twenty-four, after ChatGPT launches, pays 2.7 billion dollars, I think, to do a licensing deal with Character AI, the net of which Gnome comes back to Google.”
David Rosenthal Oct 6, 2025 ▶ 2:30:00
Assertion Contradicted
Google Nerfed LaMDA in AI Test Kitchen to Five-Turn Conversations
“For the version of Lambda chat that is in AI test kitchen, they stop all conversations after five turns. So you can only have five turns of conversation with the chat bot, and then it's just, and we're done for today.”
David Rosenthal Oct 6, 2025 ▶ 2:31:10
Opinion
ChatGPT Provides a Better UX Than Google Search for the Same Job
“ChatGPT is a better user experience to do the same job function that Google search does.”
David Rosenthal Oct 6, 2025 ▶ 2:32:32
Assertion Partly supported
Microsoft Announced $10B OpenAI Investment in January 2023
“January 23, when OpenAI hits a hundred million registered users for ChatGPT, Microsoft announces they are investing another ten billion dollars in OpenAI. And says that they now own 49% of the for-profit entity.”
David Rosenthal Oct 6, 2025 ▶ 2:37:39
Assertion Supported
Google Stock Dropped 8% After Flubbed Bard Keynote
“After the Bard launch and this keynote, Google stock drops eight percent on that day.”
David Rosenthal Oct 6, 2025 ▶ 2:39:37
Insight
Scaling Laws Force Tech Giants to Centralize on One Model
“And because of scaling laws, you need your models to be as big as possible in order to have the best performance possible. If you're trying to maintain multiple models within a company, you're repeating multiple huge costs to maintain huge models. You definite…”
David Rosenthal Oct 6, 2025 ▶ 2:44:56
Assertion Supported
Stanford's DARPA-Winning Vehicle Innovated Purely in Software Using Commodity Hardware
“The Stanford team did the exact opposite. They viewed any new piece of hardware as something that could fail, and so in order to mitigate risks on race day, they used all commodity cameras and sensors that they just mounted on a nearly unmodified Volkswagen. S…”
Ben Gilbert Oct 6, 2025 ▶ 2:49:49
Assertion Supported
Project Chauffeur Was Google X's First Project
“This Project Chauffeur that would become Waymo is the first project inside Google X.”
Ben Gilbert Oct 6, 2025 ▶ 2:52:25
Assertion Supported
Google's Self-Driving Team Completed the 'Larry 1000' Within 18 Months
“So, they start the project in 2009. Within 18 months, this tiny team, I think they hired, I don't know, it's like a dozen people or something. They've driven thousands of miles autonomously, and they managed to succeed in the full Larry 1000 within 18 months.”
Ben Gilbert Oct 6, 2025 ▶ 2:54:00
Assertion Contradicted
Eric Schmidt Proposed Google Acquire Tesla for Self-Driving Tech
“There's what Eric Schmidt wanted, which is crazy. He proposed, oh, let's just go buy Tesla, and that'll be our starting place, and then we'll just put all of our self-driving equipment on all the cars.”
Ben Gilbert Oct 6, 2025 ▶ 2:55:06
Assertion Contradicted
Google Could Have Acquired Tesla for $3 Billion
“It was three billion.”
Ben Gilbert Oct 6, 2025 ▶ 2:55:36
What-if
OpenAI Probably Would Not Exist if Google Had Bought Tesla
“I mean, I think if that had happened, DeepMind would not have gone down in the same way, and probably OpenAI would not have gotten founded.”
David Rosenthal Oct 6, 2025 ▶ 2:55:44
Assertion Supported
Waymo Raised $3.2B in March 2020 with Alphabet Majority Ownership
“March of twenty-twenty, they raise 3.2 billion dollars from folks like Silver Lake Canada Pension and Investment Board Mubadala, Andreessen Horowitz, and of course, the biggest check, I think, Alphabet, and I think they're always the biggest check, because Alp…”
Ben Gilbert Oct 6, 2025 ▶ 2:58:03
Assertion Supported
Waymo Launched the World's First Commercial Driverless Service in Phoenix
“In October of twenty-twenty, they launched the first public, commercial, no human behind the driver's seat thing in Phoenix. It's the first in the world.”
Ben Gilbert Oct 6, 2025 ▶ 2:58:21
Assertion Supported
Waymo Reportedly Surpassed Lyft in San Francisco Gross Bookings in January 2025
“This year, in January, they were reportedly doing more in gross bookings than Lyft in San Francisco.”
Ben Gilbert Oct 6, 2025 ▶ 2:59:39
Assertion Supported
Waymo Surpasses 100M Driverless Miles and 10M Paid Rides
“They've now driven over a hundred million miles with no human behind the wheel, growing at two million every week. There's over ten million paid rides across 2000 vehicles in the fleet.”
Ben Gilbert Oct 6, 2025 ▶ 3:01:06
Prediction Open · timeframe Dec 2026
Waymo to Expand Across Multiple US Cities and Launch in Tokyo
“They're going to be opening a bunch more cities in the U.S. Next year. They're launching in Tokyo, their first international city, slowly and then all at once.”
Ben Gilbert Oct 6, 2025 ▶ 3:01:17
Assertion Supported
Waymo Study Shows 91% Reduction in Serious Injury Crashes vs Human Drivers
“The study that Waymo just released last month showed that they have 91% fewer crashes with serious injuries or worse compared to the average human driver, even controlled for the fact that Waymo's right now are only driving on city surface streets.”
Ben Gilbert Oct 6, 2025 ▶ 3:03:13
Assertion Supported
Global Automaker Market Cap Is $2.5T With Tesla, $1.3T Without
“One total market size thing you could do is try to sum the entire automaker market cap today, and that would be two and a half trillion globally, if you include Tesla, or 1.3 trillion without.”
Ben Gilbert Oct 6, 2025 ▶ 3:04:48
Prediction Not checkable as stated
Waymo Can Become a Google-Sized Business if Costs Drop
“You could see a path to a Google-sized opportunity for Waymo as a standalone company just through this analysis, as long as they figure out a way to get costs down to the point where they can run this as a large and profitable business.”
Ben Gilbert Oct 6, 2025 ▶ 3:07:06
Assertion Not checkable as stated
Waymo Has Burned $10B to $15B Developing Autonomous Driving
“When you consider this opportunity, they have burned somewhere in the neighborhood of 10 to fifteen billion dollars.”
Ben Gilbert Oct 6, 2025 ▶ 3:07:31
Assertion Supported
Pichai Decreed Brain-DeepMind Merger and Gemini Standardization in Mid-2023
“Sundar makes these Two decrees mid-twenty-twenty-three. One, we're merging Brain and DeepMind into one team for AI within Google, and two, we're gonna standardize on one model, the future Gemini, and DeepMind slash Brain team. You go build it, and then everybo…”
David Rosenthal Oct 6, 2025 ▶ 3:08:21
Assertion Supported
Sergey Brin Returned to Google as an Employee for Gemini
“Not to mention, apparently, Sergey Brin is, like, now back as an employee working on Gemini.”
Ben Gilbert Oct 6, 2025 ▶ 3:08:45
Assertion Supported
Noam Shazeer and Jeff Dean Are Co-Technical Leads for Gemini
“Once they get Noam back, when they do the deal with Character AI, bring him back into the fold, Noam joins the Gemini team, and Jeff and Noam are the two co-technical leads for Gemini now”
David Rosenthal Oct 6, 2025 ▶ 3:09:18
Assertion Supported
Google Launched Gemini 1.5 with Market-Leading 1M Token Context Window
“February, twenty-twenty-four, they launched Gemini 1.5 with a one million token context window. Much, much larger context window than any other model on the market.”
David Rosenthal Oct 6, 2025 ▶ 3:11:18
Assertion Supported
Google Announced Gemini Reached 450M Monthly Active Users
“So they announced there are now four hundred and fifty million monthly users of Gemini.”
David Rosenthal Oct 6, 2025 ▶ 3:13:15
Opinion
Meta AI's User Numbers Are Inflated by Accidental Instagram Searches
“That was complete garbage. That was people searching Instagram who accidentally hit a llama model that made some things happen, and they were like, oh, go away. I actually am just looking for a user.”
Ben Gilbert Oct 6, 2025 ▶ 3:13:54
Opinion
US Antitrust Search Remedies Against Google Are Immaterial
“The judge first ruled that Google was a monopoly in internet search, and then did not come up with any material remedies. I mean, there are some, But I would call them immaterial. They did not need to spin off Chrome, and they did not need to stop sending tens…”
Ben Gilbert Oct 6, 2025 ▶ 3:15:33
Opinion
Unprofitable AI Startups Are Not Self-Sustaining Competition for Google
“None of these AI companies are generating net income, and just because they've raised a huge amount of money, It doesn't mean that will last forever. They'll all burn through their existing cash in a pretty short period of time, and if the spigots ever dry up,…”
Ben Gilbert Oct 6, 2025 ▶ 3:16:35
Opinion
ChatGPT Surprise Was Worth It if Google Avoids Antitrust Breakup
“As flat-footed as Google was when ChatGPT happened, if the outcome of this is they avoid a Microsoft-level distraction and damage to their business from a U.S. Federal court monopoly judgment, worth it.”
David Rosenthal Oct 6, 2025 ▶ 3:17:02
Assertion Contradicted
Google's $140B Earnings Trail Only Saudi Aramco Globally
“On the earnings side, they've generated a hundred and forty billion over the last 12 months, which is more profit than any other tech company, and the only company in the world with more earnings is Saudi Aramco.”
Ben Gilbert Oct 6, 2025 ▶ 3:17:58
Assertion Partly supported
Google's Core Business Has Grown 5x Since 2015/2016
“Google's core business has continued to grow five X since the end of our Alphabet episode in 2015, 20 16.”
David Rosenthal Oct 6, 2025 ▶ 3:18:21
Assertion Supported
Google One Has Over 150 Million Paying Subscribers
“What we do know is there are over a hundred and fifty million paying subscribers to the Google One bundle.”
Ben Gilbert Oct 6, 2025 ▶ 3:20:57
Assertion Partly supported
Google Cloud GTM Team Grew from 150 to 10,000
“They hired, like, 10,000 people into the go-to-market organization. I'm not exaggerating that, and that's on a base of a 150 people when he came in, most of which were seeded in California, not regionally distributed throughout the world.”
Ben Gilbert Oct 6, 2025 ▶ 3:27:09
Assertion Partly supported
Google Cloud Exceeds $50B Run Rate at 30% Growth
“And today, they're over fifty billion dollars in annual revenue run rate. It's growing 30% year over year. They're the fastest growing of the major cloud providers, five X in five years.”
Ben Gilbert Oct 6, 2025 ▶ 3:27:56
Prediction Held up
Neoclouds Will Offer Google TPUs in the Coming Months
“I think within a year it might happen. There are rumors already that some NeoClouds in the coming months are gonna have TPUs.”
Ben Gilbert Oct 6, 2025 ▶ 3:31:22
Assertion Contradicted
Google Is the Only Frontier AI Model Maker with Self-Sustaining Funding
“Google is the only model maker who has self-sustaining funding.”
David Rosenthal Oct 6, 2025 ▶ 3:34:14
Assertion Supported
Nvidia Charges 75% to 80% Gross Margins on AI Chips
“Everyone is paying NVIDIA 75, 80% gross margins, implying something like a four or five X markup on what it costs to make the chips.”
Ben Gilbert Oct 6, 2025 ▶ 3:36:51
Assertion Not checkable as stated
AI Data Center Costs Are Over 50% Chips, Under 6% Power
“I've seen estimates that over half the cost of running an AI data center is the chips and the associated depreciation. The human cost, that R&D is actually a pretty high amount because hiring these AI researchers and all the software engineering Is meaningful.…”
Ben Gilbert Oct 6, 2025 ▶ 3:38:52
Prediction Not checkable as stated
AI Chat Ad Rates Will Be Dramatically Higher Than Search Ads
“So, there should be an ad model that emerges, and ad rates should actually be dramatically higher because you have perfect precision.”
Ben Gilbert Oct 6, 2025 ▶ 3:41:37
Assertion Supported
Google Generates Approximately $400 Per US User Annually
“Google makes something like four hundred-ish dollars per user per year, just based on some napkin math in the US.”
Ben Gilbert Oct 6, 2025 ▶ 3:43:22
Prediction Not checkable as stated
Google's AI Market Share Will Stabilize Between 25% and 50%
“They own 90% of the search market. I don't know what they own of the AI market, but it ain't 90%. Is it 25%? I don't know, but at steady state it probably will be something like 25, maybe up to 50%, but This is going to be a market with several big players in …”
Ben Gilbert Oct 6, 2025 ▶ 3:44:36
Prediction Not checkable as stated
AI Will Capture the Highest-Value Search Query Use Cases
“AI might take away the majority of the use cases of search, and even if it doesn't, I bet it takes away a lot of the highest value ones.”
Ben Gilbert Oct 6, 2025 ▶ 3:45:02
Assertion Supported
Google's Monthly AI Token Volume Grew 50x in One Year
“In April of 24, Google was processing 10 trillion tokens across all their surfaces. In April of 25, that was almost 500 trillion. That's a fifty-x increase in one year of the number of tokens that they're vending out across Google services through inference.”
Ben Gilbert Oct 6, 2025 ▶ 3:48:40
Assertion Supported
Google Reached Nearly 1 Quadrillion Inference Tokens by June 2025
“And between April of 25 and June 25, it went from a little under 500 trillion to a little under one quadrillion tokens. Technically 980 trillion.”
Ben Gilbert Oct 6, 2025 ▶ 3:49:04
Assertion Open · timeframe Oct 2025
Page and Brin Would Rather Risk Bankruptcy Than Lose at AI
“Larry and Sergey control the company. They have been quoted repeatedly saying that they would rather go bankrupt than lose at AI.”
Ben Gilbert Oct 6, 2025 ▶ 3:51:58
Opinion
Google Is Threading the AI Needle Better Than Other Big Tech
“I think if you look at all the big tech companies, Google, as unlikely as it seems given how things started, Is probably doing the best job of trying to thread the needle with AI right now, and that is incredibly commendable to Sundar and their leadership.”
David Rosenthal Oct 6, 2025 ▶ 3:53:11
Made with StarZero

Turn any episode into a week of clips.

This entire site, nearly 80 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.