nvidia-h100
also referred to as: h100
part of NVIDIA
5 statements across 1 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Sep 6, 2023 by David Rosenthal · said 31 times in 6 episodes since 2022 · across every show →
Mentions by year
brought up most by Ben Gilbert (18), David Rosenthal (13)
tap a year for its mentions
2025 1 mention in 1 episode
2023 28 mentions in 4 episodes 7 per episode
2022 2 mentions in 1 episode
Everything said about nvidia-h100, oldest first
Sep 6, 2023 bullish
Nvidia bifurcated its architecture to monopolize TSMC's CoWoS packaging capacity
“And by NVIDIA bifurcating their chip architectures into a gaming segment that does not have this latest COWAS technology, this allows them to monopolize, like, a huge amount of TSMC's capacity to make the COWAS chips, specifically for these H-one hundreds, whi…”
Sep 6, 2023
Sep 6, 2023 bullish
Sep 6, 2023 neutral
On-chip memory capacity is the primary hardware bottleneck in AI training
“The constraint today is actually in how much high-performance memory is available on the chip. These models need to be in memory all at the same time, and they take up hundreds of gigabytes. So while memory has scaled up, I mean, we're gonna get flashing all t…”
Sep 6, 2023 neutral
Cloud instances cost $30 hourly for A100s and $100 hourly for H100s
“You can get access to a DGX server. That's eight A 100 for about 30 bucks an hour, or you can go over to AWS and get a P five dot 48 X large instance, which is eight H 100, which I believe is an HGX server for about a hundred dollars an hour.”