nvidia-h100

also referred to as: h 100 · h100 · nvidia h100 · nvidia h100 gpus

part of NVIDIA

4 statements across 2 episodes · 6 bullish · 0 bearish · 7 people on the record · first statement Jun 20, 2023 by George Hotz · said 102 times in 33 episodes since 2023 · across every show →

Mentions by year

brought up most by Dylan Patel (17), Sarah Chieng (9), Chris Lattner (6), Alessio Fanelli (5), Philip Kiely (4), Evan Conrad (4), Yining Zhang (3), Yi Tay (3)

tap a year for its mentions
0020840152023202420252026episodesmentions
08152023202420252026episodes it came up in
0047.58152023202420252026episodesmentions per episode
2026 16 mentions in 9 episodes 2 per episode
2025 30 mentions in 11 episodes 3 per episode
2024 34 mentions in 10 episodes 3 per episode
2023 22 mentions in 3 episodes 7 per episode

every mention, scene by scene, with the transcript →

Everything said about nvidia-h100, oldest first

Jun 20, 2023 bullish
Prediction Not checkable as stated
Hotz: Tinybox will be 5x faster than H100 systems per dollar
“For 90% of most companies model training use cases, the tiny box will be five X faster for the same price.”
George Hotz Jun 20, 2023 ▶ 48:45 Ep 18: Petaflops to the People — with George Hotz of tinycorp
Dec 5, 2023 bullish
Prediction Partly held up
Patel: Intel will release a chip surpassing Nvidia H100 within a quarter
“Intel bought that company from him, and then shut it down, and bought this other AI company, and now that company is kind of, ah, you know, got new chips. They're gonna release a better chip than the H 100, ah, within the next quarter or so, right?”
Dylan Patel Dec 5, 2023 ▶ 41:01 The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis
Dec 5, 2023 bullish
Prediction Held up
Patel: Nvidia will sell over 3 million GPUs in 2024
“NVIDIA is going to sell well over three million, you know, total GPUs next year. You know, over a million H 100 this year alone, right?”
Dylan Patel Dec 5, 2023 ▶ 7:46 The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis
Dec 5, 2023 bullish
Prediction Held up
Patel: AMD MI300 will beat Nvidia H100 on paper within a quarter
“AMD. They have a GPU. MI 300. That will be better than the H 100 in a quarter or so. Now, that says nothing about how hard it is to program it, but at least hardware-wise, on paper, it's better.”
Dylan Patel Dec 5, 2023 ▶ 41:13 The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis
Mar 6, 2024 bullish
Prediction Held up
Chintala: Meta will have over 600k H100 GPU equivalents by end of 2024
“That is by the end of this year, and 600 K H-One hundred equivalents. With 250 K H-one hundreds and including all of the other GPU or accelerator stuff, it would be 600 and something K aggregate capacity.”
Soumith Chintala Mar 6, 2024 ▶ 46:07 Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
Jul 5, 2024
Disclosure
Tay: Reka relied on 500 A100s during major H100 delivery delays
“For a long period of time, we had, 500 A-One hundreds, because we made a commitment, like and they were constantly being delayed, I think, because of H-One hundred, supply demand, whatever, like, reasons that and it was also very hard to get, like, a lot of co…”
Yi Tay Jul 5, 2024 ▶ 47:12 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jan 19, 2025 neutral
Assertion Supported
Zhang: DeepSeek-V3 cannot run on a single 8xH100 GPU node
“You need, I think 671 gigabytes for the weights, and you also need an extra memory for the KV cache, so it's not possible to run that on H-one hundred.”
Yining Zhang Jan 19, 2025 ▶ 2:46 DeepSeek V3, SGLang, and the state of Open Model Inference in 2025 (Quantization, MoEs, Pricing)
Nov 3, 2025 bullish
Assertion Supported
AMD MI300X outperforms Nvidia H100 on FlashAttention-2 and memory-bound workloads
“We found that it's great for flash attention to specifically, we were able to be H-one hundred. We also found that like the less time you spend in like dense compute, like the less time you spend in tensor cores specifically, or less time you spend in lower bi…”
Quentin Anthony Nov 3, 2025 ▶ 3:19 How Zyphra went all-in on AMD + Why Devs feel faster with AI but are slower — with Quentin Anthony
Feb 24, 2026 neutral
Assertion Contradicted
O'Laughlin: Running Kimi agent swarms requires 16 Nvidia H100 nodes
“To just run the swarm, I think it's like a 16 node of H-one hundreds.”
Doug O'Laughlin Feb 24, 2026 ▶ 35:31 Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.