nvidia-h100, every mention

mentionsepisodesper episode tap a year for its mentions

Verbatim, from the transcripts: the passages where nvidia-h100 comes up

loading…

▶ 40:22 Ryan Greenblatt So if hypothetically it was the case that tomorrow a recipe for training super, super intelligence on like, you know, 64 H 100 or like some small amount of compute just dropped.

▶ 0:54 Matt Turck How you finance billions of dollars of data centers and chips, why a 2023 H-one hundred can be more expensive to list today than when it was bought, and what it actually takes to stand up a gigawatt scale AI factory.
▶ 2:57 Stephen Balaban Yeah, so when you look at, for example, I think it's actually worth doing is to try to, like, kind of dig into some of the methodology on, for example, an index like, there's, there's the, there's the index that's on Bloomberg for H 100…
▶ 17:24 Stephen Balaban If you look at the cost structure of let's say one GPU hour of time, you know, we were talking about H 100.
▶ 25:53 Stephen Balaban We've got everything from V-one-hundredths, A-one-hundredths, H-one-hundredths, H-two-hundredths, uh, B-two-hundredths, G-H-two-hundredths, or GB-two-hundredths, B-three-hundredths, and VR-two-hundredths coming soon.
▶ 40:40 Stephen Balaban Because, you know, you actually look at the chips that we deployed in twenty-twenty-three, H-one hundreds. 2 times in the scene

▶ 17:34 Dan Fu On last generation, kind of nerfed GPUs, H 800 instead of H 100, the 800 is nerfed by all sorts of ways from, from NVIDIA, um, to, to get around the, the expert restrictions at the time. 2 times in the scene

▶ 48:48 Gaurav Misra And by the way, like the H 100 and A 100 kind of suck at encoding and decoding video, right? 3 times in the scene

▶ 7:35 Erik Bernhardsson Like, you know, traditionally all these like LM inference, you know, providers obviously been building on H 100 or, you know, Nvidia GPUs, but
▶ 35:03 Erik Bernhardsson Like, for a while, like, each 100 prices were, like, almost, like, going up, and then they were kind of still for a while, and then now they're, like, actually going down quite a lot, like, you know, what I'm seeing in the market, right?

▶ 36:34 Aravind Srinivas Uh, we'll end up in a situation like how, um, you know, like say, NVIDIA, for example, controls the GPU computer and like, nobody can tell them what, what, you know, you got a price H-one or something.

▶ 28:34 Kanjun Qiu And then NVIDIA is also part of the round because we have a very large GPU cluster of 10,000 H 100, and it's very helpful to have NVIDIA as part of that.

Turn any episode into a week of clips.