AlexNet
product on 18 shows · 16 statements across 11 episodes · said 126 times in 57 episodes since 2021
Acquired 39 
Latent Space 20 
the Y Combinator Startup Podcast 13 
No Priors 13 
the a16z Podcast 10 
the Neon Show 7 
the MAD Podcast 5 
Big Technology 3 
All-In 3 
TBPN 3 
Invest Like the Best 2 
Sourcery 2 
Innovators & Investors 1 
Cheeky Pint 1 
American Optimist 1 
Lenny's Podcast 1 
WTF is with Nikhil Kamath 1 
20VC 1
Mentions by year, every show
tap a year for its mentions
Acquired 39Latent Space 20No Priors 13the Y Combinator Startup Podcast 13the a16z Podcast 10the Neon Show 7the MAD Podcast 5All-In 310 more shows
2026 24 mentions in 13 episodes 2 per episode
- Jensen Huang: The Mindset That Built NVIDIA · Y Combinator
- Why Rule-Breaking Is the Only Rule in Venture Capital | Ashmeet Sidana, Engineering Capital
- FPV Drones -The Next War Is Already Here — Yaroslav Azhnyuk, The Fourth Law & Noah Smith, Noahpinion
- World's Top Researcher on AI, LLMs, and Robot Intelligence · Invest Like The Best
- How Open Source Became AI's Backbone | Inferact with a16z
- And How Matic Won By Choosing the Most Boring Market in Robotics with Founders Mehul and Navneet
- The GPU Myth: State of AI Compute 2026 | Stephen Balaban
- Redefining Digital Consciousness with Vishnu Hari of ego | The Innovators & Investors Podcast
- 5 more episodes that year, every mention in 2026 →
2025 48 mentions in 21 episodes 2 per episode
- Google Part III: The AI Company. Google is amazingly well-positioned... will they win in AI? (Audio) · Acquired
- After LLMs: Spatial Intelligence and World Models — Fei-Fei Li & Justin Johnson, World Labs
- Fei-Fei Li: Spatial Intelligence is the Next Frontier in AI · Y Combinator
- Arm CEO Rene Haas on AI: Nvidia Lessons, Intel’s Decline and the US-China Chip War
- No Priors Ep. 117 | With Co-Director of Stanford's HAI & Founder of World Labs Dr. Fei-Fei Li
- Google Part II: Alphabet (Audio) · Acquired
- NVIDIA VP Rev Lebaredian Talks Plan To Build AI That Understands The Real World
- Ilya Sutskever on Dwarkesh Patel Reaction, NVIDIA vs Google, Trump Unveils Genesis | Diet TBPN
- 13 more episodes that year, every mention in 2025 →
2024 18 mentions in 9 episodes 2 per episode
- “The Future of AI is Here” — Fei-Fei Li Unveils the Next Frontier of AI
- Breaking down the OG GPT Paper by Alec Radford
- Meta (Audio) · Acquired
- No Priors Ep. 87 | With Co-CEO of Waymo Dmitri Dolgov
- How Waymo Is Using GenAI to Build a Better Driver
- No Priors Ep. 89 | With NVIDIA CEO Jensen Huang
- Production AI Engineering starts with Evals
- David Luan: Why Nvidia Will Enter the Model Space & Models Will Enter the Chip Space | E1169 · 20VC with Harry Stebbings
- 1 more episode that year, every mention in 2024 →
2023 25 mentions in 10 episodes 3 per episode
- Nvidia Part III: The Dawn of the AI Era (2022-2023) (Audio) · Acquired
- NVIDIA CEO Jensen Huang · Acquired
- No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever
- The End of Finetuning — with Jeremy Howard of Fast.ai
- Beating GPT-4 with Open Source Models - with Michael Royzen of Phind
- Improving AI with Anthropic's Dario Amodei
- No Priors Ep. 16 | With Mustafa Suleyman, Founder of DeepMind and Inflection
- No Priors Ep. 2 | With Runway ML’s Cristobal Valenzuela
- 2 more episodes that year, every mention in 2023 →
2022 9 mentions in 2 episodes 5 per episode
every mention on every show, scene by scene, with the transcript →
16 statements about AlexNet, every show
Bornstein: AlexNet originally ran on only two GPUs
“AlexNet, First, you know, kind of, like, neural network to run on, on GPUs that we care about ran on two GPUs. And that's not like there are no missing decimal points or commas in there. Literally two.”
Huang: NVIDIA realized AlexNet was a universal method to learn any function
“The breakthrough for us was realizing that AlexNet was not AlexNet. That AlexNet was an approach with deep, deep learning that allows you to learn any function.”
Andreessen: AlexNet and transformers were the true inflection points of modern AI
“I think the real story is it was the Alex net basically breakthrough in like 2013. That was the real knee in the curve. And then it was obviously the transformer breakthrough in 17.”
Sidana: AlexNet, not ChatGPT, was the true technical AI inflection point
“The technical inflection point was AlexNet, because AlexNet is what demonstrated that by scaling a neural net, you get disproportionate outcome.”
Zeghidour: Deep learning's first major success was speech recognition, preceding AlexNet
“Actually the really first big success in deep learning was speech recognition. We've worked from Geoffrey Hinton himself.”
Johnson: AI compute per model has scaled one million-fold since 2012
“And if you think about, you know, AlexNet required this jump from CPUs to GPUs, but even from AlexNet to today, we're getting about a thousand times more performance per card than we had in AlexNet days. And now it's common to train models, not just on one GPU…”
AlexNet Reduced ImageNet Error Rates from 25% to 15% in 2012
“Along comes AlexNet. Its error rate was 15%. Still high, but a 10% leap from the previous best being a 25% error rate all the way down to 15 in one year. A leap like that had never happened before.”
AlexNet Was Trained on Two Off-the-Shelf Nvidia GTX 580 GPUs
“They buy two NVIDIA GeForce GTX five eighties, which were NVIDIA's top of the line gaming cards at the time. The Toronto team rewrites their neural network algorithms in CUDA, NVIDIA's programming language. They train it on these two off the shelf GTX five eig…”
Justin Johnson: AlexNet trained for six days on two consumer GPUs
“That AlexNet was a sixty million parameter deep neural network and it was trained for six days on two GTX five eighties, which was the top consumer card at the time, which came out in 2010.”
Justin Johnson: AlexNet's 6-day training takes under 5 minutes on GB200
“So I ran the numbers last night, like that two week training run, that of six days on two GTX five eighties, if you scale, it comes out to just under five minutes on a single GB 200.”
Fei-Fei Li: AlexNet's architecture mirrored 1980s models, unlocked by GPUs
“The 2012 AlexNet paper on ImageNet Challenge is literally a very classic model, and that is the convolutional neural network model, and that was published in 19 eighties, the first paper. I remember as a graduate student learning that, and it more or less also…”
Sutskever: Early neural networks failed primarily because they were too small
“The reason neural networks of the time weren't good is because they were too small. So like if you try to solve a vision task with a neural network, which has like a thousand neurons, what can it do? It can't do anything. It doesn't matter how good your learni…”
AlexNet reduced ImageNet mislabeling error rates from 25% to 15%
“I think the error rate went from mislabeling images 25% of the time to suddenly only mislabeling them 15% of the time, and that was like a huge leap over the tiny incremental progress that had been made along the way.”
AlexNet was trained on two consumer Nvidia GeForce GTX 580 GPUs
“And what these guys from Toronto did is they went out probably to their local Best Buy or equivalent in Canada. They bought two GeForce GTX-Five-Eighty's, which were the top-of-the-line cards at the time, and they wrote their algorithm, their convolutional neu…”
Rosenthal: Jensen Huang did not anticipate AlexNet's breakthrough
“Jensen did not plan Alex net or see it coming cause nobody saw Alex net coming.”
Rosenthal: AlexNet on CUDA was the 'big bang' moment for AI
“We cannot overstate the importance of this moment, not just for NVIDIA, but for, like, computer science, for technology, for business, for the world, for us staring at the screens of our phones all day every day. This was the big bang moment for artificial int…”