NVLink
product on 10 shows · 10 statements across 7 episodes · said 58 times in 28 episodes since 2022
Latent Space 15 
No Priors 9 
BG2 Pod 8 
the Y Combinator Startup Podcast 7 
Invest Like the Best 5 
Acquired 4 
the MAD Podcast 3 
the a16z Podcast 3 
All-In 2 
TBPN 2
Mentions by year, every show
tap a year for its mentions
Latent Space 15No Priors 9BG2 Pod 8the Y Combinator Startup Podcast 7Invest Like the Best 5Acquired 4the MAD Podcast 3the a16z Podcast 32 more shows
2026 20 mentions in 8 episodes 3 per episode
- Multi-GPU Kernels, Intelligence per Watt, Heterogeneous Inference, and More | YC Paper Club · Y Combinator
- Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
- Agent Inference at the "Speed of Light" — How NVIDIA moves like a $4.3 Trillion Startup
- Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten
- Inside Nemotron & NVIDIA’s AI Lab | Bryan Catanzaro
- The GPU Myth: State of AI Compute 2026 | Stephen Balaban
- The Remarkable AGI Predictions of Daniel Gross
- NVIDIA’s Jensen Huang on Reasoning Models, Robotics, and Refuting the “AI Bubble” Narrative
- every mention in 2026, scene by scene →
2025 7 mentions in 5 episodes 1 per episode
- NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner · Bg2 Pod
- Dylan Patel on the AI Chip Race - NVIDIA, Intel & the US Government vs. China
- "Is there an AI bubble?” Gavin Baker and David George
- 🕰️ The Oral History of Windsurf (ft. Varun Mohan, Scott Wu, Jeff Wang, Kevin Hou, Anshul R)
- Weekly Recap - Elon Vs Trump, Ukraine's Drone Attack, Cluely Update & OpenAI CRO
- every mention in 2025, scene by scene →
2024 24 mentions in 12 episodes 2 per episode
- No Priors Ep. 89 | With NVIDIA CEO Jensen Huang
- Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
- New SEC Chair, Bitcoin, xAI Supercomputer, UnitedHealth CEO murder, with Gavin Baker & Joe Lonsdale
- State of the Art: Training 70B LLMs on 10,000 H100 clusters
- Supervise the Process of AI Research — with Jungwon Byun and Andreas Stuhlmüller of Elicit
- Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
- No Priors Ep. 95 | Best of 2024
- AI Semiconductor Landscape feat. Dylan Patel | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod
- 4 more episodes that year, every mention in 2024 →
2023 6 mentions in 2 episodes 3 per episode
2022 1 mention in 1 episode
every mention on every show, scene by scene, with the transcript →
10 statements about NVLink, every show
Movva: Sharding matrix multiply across eight GPUs yields only 4x to 5x speedup
“You'll use eight times more hardware, but you won't get eight times the speed. You might get like four to five X the speed. You're not going to get strong scaling. And this is because of communication overhead.”
Movva: NVLink is mandatory for low-latency AI inference
“NVLink is mandatory, I would say, for low latency inference.”
Movva: Rival chipmakers will not replicate NVIDIA's NVLink quickly
“I think I'm not holding my breath for other companies broadly to figure out NVLink quickly. It's challenging technology to figure out. It's hard to scale. It's hard to productionize.”
Tensor parallelism is a poor fit for local multi-device AI setups
“Tensor parallelism is not a good fit for local AI because it assumes a very high bandwidth interconnects like NVLink was, you know, They might be forced to do something like pipeline parallelism, which we're never going to do unless we're doing some kind of mu…”
Stuart: Single NVLink domains will soon scale to hundreds of GPUs
“And you also have a scale of architectures like NBL-L-Seventy-Two, which packs 72 GPUs inside a single NVLink domain, and soon this is going to extend to hundreds of GPUs.”
Stuart: TMA saturates NVLink on Blackwell using roughly 15 SMs
“So on Blackwell, we find that with roughly 15 SMs out of one 48 TMA is able to saturate the NVLink.”
Scaling beyond eight NVIDIA H100 GPUs requires inter-GPU communication over InfiniBand
“The maximum NVLink domain, domain for H 100 for most DGX H 100 Is eight GPUs, right? So if you scaled up past that, You're gonna have to figure out ways to handle the fact that now for the GPUs to communicate, you have to do it over InfiniBand, which is still …”
Huang: NVIDIA Bought Mellanox to Treat Data Center Networks as Compute Fabrics
“That, that's the reason why we bought Mellanox and started fusing InfiniBand and MVLink in such an aggressive way.”
Gurley: NVIDIA's competitive advantage is strongest at massive system scale
“NVIDIA's competitive advantage is strongest where the size of the system is largest, which is another way of saying what Renee said. It's flipping it on its head. It's not to say it's weak on the edge, but it's super powerful when you put a whole bunch of them…”
Chintala: Nvidia's primary competitive moat is NVLink interconnect, not GPU silicon
“The mode that Nvidia has right now, I feel like, is that they're, they have the interconnect that no one else has. Like, AMD GPUs are pretty good. I'm sure there's very silicon that is not bad at all, but, like, the interconnect like, NVLink is uniquely awesom…”