transformer

5 statements across 3 episodes · 3 bullish · 1 bearish · 2 people on the record · first statement Sep 6, 2023 by Ben Gilbert · said 33 times in 3 episodes since 2023 · across every show →

Mentions by year

brought up most by David Rosenthal (23), Ben Gilbert (10)

tap a year for its mentions
00201402202320242025episodesmentions
012202320242025episodes it came up in
00101202202320242025episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about transformer, oldest first

Sep 6, 2023 positive
Insight
Transformers enabled parallel training of sequence models on GPUs
“So the big innovation here is you could now train sequence-based models In a parallel way. You couldn't train models of this size at all before, let alone cost effectively.”
Ben Gilbert Sep 6, 2023 ▶ 34:54 Nvidia Part III: The Dawn of the AI Era (2022-2023) (Audio) · Acquired
Aug 26, 2025 positive
Assertion Supported
Google Invented and Published the Revolutionary Transformer Architecture in June 2017
“Google invented the Transformer and published the paper in June of 2017.”
David Rosenthal Aug 26, 2025 ▶ 3:40:43 Google Part II: Alphabet (Audio) · Acquired
Oct 6, 2025 neutral
Assertion Supported
OpenAI Introduced Pre-trained Transformers with GPT-1 in June 2018
“So in June of 2018, OpenAI releases a paper describing how they have taken the transformer and developed a new approach of pre-training them on very large amounts of general text on the internet, and then fine tuning that general pre-training to specific use c…”
David Rosenthal Oct 6, 2025 ▶ 2:07:33 Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired
Oct 6, 2025 bearish
Opinion
2017 Began a 5-Year Period of Google Failing on Transformers
“It is fair to say that 2017 begins the five-year period of Google not sufficiently seizing the opportunity that they had created.”
Ben Gilbert Oct 6, 2025 ▶ 2:03:40 Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired
Oct 6, 2025 positive
Assertion Not checkable as stated
Modern AI Revolution Is Predicated on Google's 2017 Transformer Invention
“The entire AI revolution that we are in right now is predicated by the invention of the transformer out of the Google brain team in 2017.”
Ben Gilbert Oct 6, 2025 ▶ 2:41 Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired
Made with StarZero

Turn any episode into a week of clips.

This entire site, nearly 80 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.