High Bandwidth Memory

also referred to as: hbm

6 statements across 4 episodes · 1 bullish · 2 bearish · 2 people on the record · first statement Feb 17, 2025 by Jonathan Ross · across every show →

Everything said about High Bandwidth Memory, oldest first

Feb 17, 2025 neutral

Assertion Contradicted

Ross: NVIDIA holds a cornered resource as HBM monopsony buyer

“You don't normally think of tech companies as having a cornered resource, but Nvidia has a cornered resource. They're a monopsony, the opposite of a monopoly, a single buyer for HBM, and the Interposer, the COOS.”

Jonathan Ross Feb 17, 2025 ▶ 16:58 Jonathan Ross, Founder & CEO @ Groq: NVIDIA vs Groq - The Future of Training vs Inference | E1260 · 20VC with Harry Stebbings

Mar 24, 2025 negative

Assertion Supported

Feldman: GPU High Bandwidth Memory Offers High Capacity but Is Slow

“They use memory, a memory called HBM, the type of DRAM, and it is phenomenal memory. But it is slow. It is slow and high capacity.”

Andrew Feldman Mar 24, 2025 ▶ 6:25 Andrew Feldman, Cerebras Co-Founder and CEO: The AI Chip Wars & The Plan to Break Nvidia's Dominance · 20VC with Harry Stebbings

Sep 29, 2025 neutral

Assertion Not checkable as stated

Ross: Securing AI Memory Allocations Requires Paying Two Years in Advance

“The problem is you have to write that check more than two years in advance.”

Jonathan Ross Sep 29, 2025 ▶ 17:29 Groq Founder, Jonathan Ross: OpenAI & Anthropic Will Build Their Own Chips & Will NVIDIA Hit $10TRN · 20VC with Harry Stebbings

Sep 29, 2025

Assertion Partly supported

Ross: NVIDIA effectively holds a monopsony on High Bandwidth Memory

“The thing is, Nvidia effectively has a monopsony on HBM.”

Jonathan Ross Sep 29, 2025 ▶ 14:26 Groq Founder, Jonathan Ross: OpenAI & Anthropic Will Build Their Own Chips & Will NVIDIA Hit $10TRN · 20VC with Harry Stebbings

Sep 29, 2025 negative

Insight

Ross: Memory Suppliers Restrict HBM Supply to Protect High Profit Margins

“There's also this situation where the margin on HBM is so high, That no one wants to actually increase the supply, because then the margin goes down.”

Jonathan Ross Sep 29, 2025 ▶ 18:01 Groq Founder, Jonathan Ross: OpenAI & Anthropic Will Build Their Own Chips & Will NVIDIA Hit $10TRN · 20VC with Harry Stebbings

May 26, 2026 positive

Disclosure

Feldman claims HBM memory shortages limit traditional GPUs but not Cerebras

“That is a limitation for all GPUs, but not us. We don't use it.”

Andrew Feldman May 26, 2026 ▶ 8:29 Cerebras CEO on the Future of Data Centres, Token Costs & Memory | Should US Companies Sell to China · 20VC with Harry Stebbings

High Bandwidth Memory

Everything said about High Bandwidth Memory, oldest first

Turn any episode into a week of clips.