Nvidia
includes NVIDIA H100, NVIDIA A100, NVIDIA Rubin, NVIDIA Blackwell, NVIDIA H200, NVIDIA Dynamo, NVIDIA Cosmos, NVIDIA GTC, NVIDIA Hopper, NVIDIA T4, NVIDIA GB300, NVIDIA A10 and 32 more
80 statements across 35 episodes · 38 bullish · 14 bearish · 34 people on the record · first statement Jun 20, 2023 by George Hotz · said 721 times in 100 episodes since 2023 · across every show →
Mentions by year, the whole family
brought up most by Shawn Wang (80), Dylan Patel (55), Kyle Kranen (43), Ali Taha (26), Ethan He (24), Chris Lattner (24), George Hotz (23), Philip Kiely (20)
tap a year for its mentions
2026 306 mentions in 30 episodes 10 per episode
- Agent Inference at the "Speed of Light" — How NVIDIA moves like a $4.3 Trillion Startup
- Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten
- Inside xAI: Building Grok Imagine in 3 Months, Videogen vs World Models, and Video Agents— Ethan He
- Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis
- Dylan Patel Explains the AI War While Cooking | In-Context Cooking
- The Inference Frontier: from 100 to 10,000 tokens per second — Sean Lie, Cerebras CTO
- The AI Frontier: from open weights to open research — Eiso Kant, Poolside AI
- Artificial Analysis: The Independent LLM Analysis House — with George Cameron and Micah Hill-Smith
- 22 more episodes that year, every mention in 2026 →
2025 191 mentions in 33 episodes 6 per episode
- ⚡️Accelerators @ 3x NVIDIA H200 perf, Made in the USA - Thomas Sohmers + Mitesh Agrawal, Positron AI
- The Shape of Compute (Chris Lattner of Modular)
- SF Compute: Commoditizing Compute
- A Technical History of Generative Media
- 2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
- How Zyphra went all-in on AMD + Why Devs feel faster with AI but are slower — with Quentin Anthony
- DeepSeek V3, SGLang, and the state of Open Model Inference in 2025 (Quantization, MoEs, Pricing)
- SAM 3: The Eyes for AI — Nikhila & Pengchuan (Meta Superintelligence), ft. Joseph Nelson (Roboflow)
- 25 more episodes that year, every mention in 2025 →
2024 122 mentions in 31 episodes 4 per episode
- [Paper Club] Weight Streaming on Wafer-Scale Clusters (w/ Sarah Chieng of Cerebras)
- Building an open AI company - with Ce and Vipul of Together AI
- State of the Art: Training 70B LLMs on 10,000 H100 clusters
- Why Google failed to make GPT-3 -- with David Luan of Adept
- The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)
- [Paper Club] SWE-Bench [OpenAI Verified/Multimodal] + MLE-Bench with Jesse Hu
- [LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models
- Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
- 23 more episodes that year, every mention in 2024 →
2023 102 mentions in 6 episodes 17 per episode
- The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis
- Ep 18: Petaflops to the People — with George Hotz of tinycorp
- Beating GPT-4 with Open Source Models - with Michael Royzen of Phind
- FlashAttention-2: Making Transformers 800% faster AND exact
- Why AI Agents Don't Work (yet) - with Kanjun Qiu of Imbue
- RWKV: Reinventing RNNs for the Transformer Era
- every mention in 2023, scene by scene →
Everything said about Nvidia, oldest first
Jun 20, 2023 positive
Jun 20, 2023 neutral
Jun 20, 2023 positive
Hotz: Google TPUs are the only successful non-Nvidia training chips
“The only company, there's one other company aside from Nvidia who's succeeded at all at making training chips... Mid journey is trained on TPU, right? Like a lot of startups do actually train on TPUs, and they're the only other successful training chip aside f…”
Nov 3, 2023 positive
Royzen: NVIDIA Remains Cloud-Agnostic Because It Wins Regardless
“At NVIDIA, They know that they're going to win regardless. So they don't care where you get the GPUs from. They're like, they're truly neutral, unlike various sales reps that you might encounter at various like clouds and, you know, hardware companies, et cete…”
Nov 3, 2023 positive
Royzen: NVIDIA Built Custom FasterTransformer Feature for Phind
“They actually implemented a custom feature for us in Faster Transformer which is one of their libraries... They implemented streaming generation for T-Five-based models, which we were running at the time up until we switched to GPT in In February, March of thi…”
Dec 5, 2023 bullish
Dec 5, 2023 neutral
Dec 5, 2023 bullish
Patel: Intel will release a chip surpassing Nvidia H100 within a quarter
“Intel bought that company from him, and then shut it down, and bought this other AI company, and now that company is kind of, ah, you know, got new chips. They're gonna release a better chip than the H 100, ah, within the next quarter or so, right?”
Dec 5, 2023 bullish
Dec 5, 2023 bullish
Patel: Nvidia to ship next-gen chip in Q2/Q3 2024 with 3x LLM performance
“Nvidia's releasing a new chip, you know, in, you know, they're gonna announce it in March, and they're gonna release it, you know, and ship it, you know, Q-two, Q-three next year anyways, right? And that chip will probably be three or four times as good. Right…”
Dec 5, 2023 neutral
Feb 8, 2024 neutral
Mar 6, 2024 bullish
Chintala: Hyperscalers build custom silicon to exploit vertical workload efficiencies
“Each large company has a sufficient enough set of verticalized workloads that have a pattern to them that, say, a more generic accelerator like an NVIDIA or an AMD GPU does not exploit. So there is some level of power efficiency that you're leaving on the tabl…”
Mar 6, 2024 bullish
Chintala: Nvidia's primary competitive moat is NVLink interconnect, not GPU silicon
“The mode that Nvidia has right now, I feel like, is that they're, they have the interconnect that no one else has. Like, AMD GPUs are pretty good. I'm sure there's very silicon that is not bad at all, but, like, the interconnect like, NVLink is uniquely awesom…”
Oct 18, 2024 positive
Oct 19, 2024
Oct 29, 2024 positive
Oct 29, 2024 positive
Oct 29, 2024 negative
Ethan He: Hugging Face's sequential GEMM loop for Mixtral is inefficient
“Let's also look at the implementation of Mixtro eight by seven on Hagen-Phys transformer. You will soon notice the, in the expert operation there, You would iterate over all of the experts and compute each of the gem operations one by one. We found that this i…”
Dec 7, 2024 positive
Cerebras WSE-3 runs Llama inference 70x faster than NVIDIA GPUs
“Cerebris came out that the wafer scale engine three can serve llama 70 B at 2.1 thousand sorry, 202,100 tokens per second and serves llama four or five B at nearly 1000 tokens per second. So this, you know, to give you an understanding, like this is about 70 t…”
Dec 24, 2024
Jan 1, 2025 bearish
Swyx: VC appetite for GPU-rich early-stage startups is completely gone
“The appetite for GPU rich startups, like the, you know, the funding plan is we will raise sixty million and we'll give 50 of that to Nvidia. That is gone, right? Like no one's pitching that. This was literally the plan, the exact plan of like, I can name like …”
Jan 4, 2025 negative
Apr 11, 2025 neutral
Conrad: NVIDIA avoids customer concentration to prevent hyperscaler price setting
“It's really bad for NVIDIA if you have customer concentration, and Microsoft and Google and Amazon, like, Oracle to, like, buy up your entire supply and then you have four or five customers or so who pretty much get to set prices.”
Apr 11, 2025 bearish
Apr 11, 2025 neutral
May 6, 2025 positive
NVIDIA's 600M Parameter Parakeet Model Tops Speech Transcription Leaderboards
“And then Parakeet is Nvidia's new speech model, speech transcription model. That's number one on the leaderboards. And it's just like very enterprise tuned, like really, really rock solid, reliable at fairly small number of weights, like six hundred million pa…”
Jun 13, 2025 negative
Jun 13, 2025
Jun 13, 2025
Jul 31, 2025
Aug 18, 2025 neutral
Aug 18, 2025 bullish
Sohmers: NVIDIA will have a very good decade ahead despite startup challengers
“The reality is NVIDIA is going to have a very, very good decade ahead for them. And The market is growing so fast that all of us in the space trying to take them on can be very happy with, you know, very, very small wins in the space.”
Aug 18, 2025 bearish
Sohmers: NVIDIA Blackwell memory bandwidth efficiency will be lower than Hopper
“All indications are, even though they, you know, more than doubled the theoretical memory bandwidth going from Hopper to Blackwell, the actual percentage of theoretical that you can achieve is, again, going to be less than the previous generation”
Aug 18, 2025 bullish
Sohmers: Positron hardware achieves 70% higher performance than NVIDIA at lower power
“So, you know, what that actually results in is like today, we're you know, able to achieve about you know, 70% higher performance than NVIDIA with the cards that we're shipping today. Significantly lower power and price point.”
Aug 18, 2025 neutral
Agrawal: Positron cannot beat NVIDIA on matrix-matrix performance per dollar today
“Thomas said that, you know, we are accelerating matrix vector. It doesn't mean that we can't do matrix, matrix. We can, and we can do it fairly well. It's just that the point becomes is like, are you really beating NVIDIA on it from a perf per dollar? And if y…”
Aug 18, 2025 bullish
Sohmers: People will continue buying NVIDIA for AI training
“We are betting that people are going to continue to train on NVIDIA for at least the foreseeable future, where, since we're able to, you know, and I'll say, I really hope others are able to be successful in, in providing competition against NVIDIA, but Given t…”
Sep 8, 2025 bearish
Oct 1, 2025 bearish
Nov 3, 2025 neutral
Nov 3, 2025 bullish
Nov 25, 2025 bearish
Johnson: Nvidia Blackwell offers roughly same performance per watt as Hopper
“Like, if you look at the numbers, like, even going from Hopper to Blackwell, like, the performance per watt is about the same. They mostly make the number of transistors go up, and they make the chip size go up, and they make the power usage go up. But even fr…”
Feb 10, 2026 positive
Datology BeyondWeb 3B matches NVIDIA Nemotron 8B in 2.7x less training time
“As you can see that we achieved the same performance as the NVIDIA model in almost, like, 2.7 X, like, lesser time. And then much faster than anything that hugging face or pajama does. Very interestingly, our three B model is pretty much the same performance a…”
Feb 24, 2026 bullish
Feb 24, 2026 bearish
Feb 24, 2026 bullish
Feb 26, 2026 neutral
Patel: Nvidia must vastly outperform rivals to overcome vertical integration
“Google, Amazon, they get to vertically integrate, integrate, and vertical integration always saves tons of money. So he has to be better than everyone. By, not just like a little bit, by a ton. To justify his margins. Otherwise, the vertical integration of his…”
Mar 8, 2026 neutral
NVIDIA mandates running OpenClaw in isolated Brev cloud VMs
“Internally people want to run this
and we know we have to be really careful from the security implications. Do we let this run on the corporate network securities guidance was, Hey, run this on breath. It's in, you know, it's a VM. It's sitting in the cloud. …”
Mar 8, 2026 neutral
Mar 8, 2026 bullish
Mar 8, 2026 positive
NVIDIA Dynamo dynamically sizes and schedules Kubernetes prefill and decode workers
“Dynamo has a set of components that A, tell you how to scale. It tells you how many pre-fill workers and decoded workers it thinks you should have. And also provides a scheduling API for Kubernetes that allows you to actually represent and affect this scheduli…”
Mar 8, 2026 positive
Mar 8, 2026 positive
NVIDIA uses 'Speed of Light' framework to define minimum viable goals
“SOL is a term that NVIDIA is used to sort of like instigate a compelling event. You say, this is done. How do we get there? What is the minimum, as much as necessary, as little as possible thing that it takes for us to get exactly here? And it helps you just b…”
Mar 8, 2026 bullish
Mar 8, 2026 neutral
NVIDIA's build.nvidia.com was internally the company's largest inference deployment
“At one point, there's a website called build.nvd.com, and also for us, inference.nvd.com, that is, allows people to try models. It gives an API service, you can call the model with like a REST API, and, you know, you get a response. I ran the model site for th…”
Mar 8, 2026 positive
Jensen Huang prioritizes strategic investments in 'zero billion dollar markets'
“Jensen, He says, we're completely happy investing in zero billion dollar markets. We don't care if this creates revenue. It's important for us to know about this market. We think it will be important in the future. It can be zero billion dollars for a while.”
Apr 2, 2026 neutral
Apr 2, 2026 bullish
Apr 3, 2026 bullish
Andreessen: Three-year-old Nvidia chips make more money today than when new
“The current models are getting better faster at such a rate that if you are running an NVIDIA, if you're running an NVIDIA inference chip today that's three years old, you're making more money on it today than you did three years ago. Because the pace of impro…”
Apr 22, 2026
Parakhin: Bing Sydney first launched in India using Megatron, not OpenAI
“The funny thing, I mean, the most interesting anecdote is that Sydney was first shipped in India for and it was not noticed for a long time. And first implementation of Sydney didn't even have open AI model under it. It was during Megatron. Microsoft and the N…”
Jun 1, 2026 positive
Jun 1, 2026
Jun 1, 2026
Ethan He: NVIDIA Cosmos required labelers to describe videos for blind reconstruction
“So that's in the protocol of Cosmos labeling. We required the objective we gave to the labelers was that you have to describe the video as detailed as possible, such that a blind person hears a blob of text, can reconstruct what the video is like from their he…”
Jun 1, 2026 positive
Jun 1, 2026 neutral
Jun 1, 2026 neutral
Jun 1, 2026 neutral
Jun 18, 2026 positive
Jun 30, 2026 bullish
Feinberg: Chipmakers will invest in life sciences as LLM alpha shrinks
“I do think that chip makers, including Nvidia, are going to want to get a lot more invested in life sciences because it will always be high in demand. And The amount of alpha left in pure LLM space is just getting a little questionable.”
Jul 10, 2026 neutral
Jul 16, 2026 positive
Beam: Lila avoids pre-training from scratch, builds on open-weight models
“We have not decided to take on pre-training as well, just because the black magic that you have to do is, is insane, and we've been gifted, you know, something like a billion dollars worth of compute in the form of open-weight models. So we start with an open-…”
Aug 3, 2026 bearish
Aug 3, 2026 bearish
TurboQuant is inefficient on high-bandwidth data center GPUs like NVIDIA B200
“TurboQuant would not be like, it would not be used. Like Nvidia made it clear that this is not a good optimization. And we've seen it firsthand where the overhead of doing dequantization, quantization of You know, in the kernel itself, the turbo-quant kernel, …”
Aug 3, 2026 positive
NVIDIA or model creators will always publish open quantized checkpoints
“There's always going to be like an open source quantized checkpoint. NVIDIA is going to push one out if no one else does. You usually the providers will have their own spec tech that they've trained as well. You don't need to train your own spec tech. You can …”
Aug 3, 2026 neutral
NVIDIA Dynamo is a developer toolkit, not an out-of-the-box performance optimizer
“I would think of Dynamo as less of a sort of out of box system and more of a toolkit for building with. So when we talk about doing KV aware routing, when we talk about doing KV out offloading, when we talk about doing PD disaggregation, Dynamo fundamentally i…”
Aug 3, 2026 bearish
NVIDIA's Vera Rubin GPU architecture effectively renders mega kernel research obsolete
“The GPU is, is It's designed in such a way that it basically kills megakernels. You don't need to use megakernels that much anymore. So it seems like that entire research field goes into, like, won't be continued, but yeah.”
Aug 3, 2026 positive
Sep 2, 2026 neutral
Sep 2, 2026 bearish
Untapped AI hardware opportunity is co-designing models for non-Nvidia architectures
“What I think is the most untapped opportunity right now frankly for Cerebrus, but frankly for the entire non-NVIDIA environment right? And the non-environ sorry community is that, you know, we're all running models that were designed for NVIDIA GPUs, right? An…”
Sep 2, 2026 bullish
OpenAI built a significantly better GPU than Nvidia with Jalapeno chip
“I think that, like, they, you know, they pushed a lot on the performance and the fact that they're significantly better than, you know, better performance than the GPU than NVIDIA. But what I see is that they've built a significantly better GPU. And that in it…”