NVIDIA A100, every mention
22 scenes · ← back to NVIDIA A100
tap a year for its mentions
every year anyone Ben Gilbert 12David Rosenthal 10
Verbatim, from the transcripts: the passages where NVIDIA A100 comes up
NVIDIA CEO Jensen Huang · Acquired
- ▶ 43:58 David Rosenthal Their data centers are filled with A-Hundreds and H-Hundreds, and as you probably know, with the rising demand for AI, there's been a huge surge in the need for high-performing GPUs, leading to a noticeable scarcity of
Nvidia Part III: The Dawn of the AI Era (2022-2023) (Audio) · Acquired
- ▶ 23:45 David Rosenthal Nvidia is one of their major partners, and literally Crusoe's data centers are nothing but racks and racks of A-one hundreds and H-one hundreds.
- ▶ 1:06:05 David Rosenthal Up until NVIDIA's current GPU generation, the hopper generation of GPUs for the data center, there was only one GPU architecture at NVIDIA, and that same architecture and those same chips from the same wafers made at TSMC, some of them…
- ▶ 1:12:55 David Rosenthal So they're selling H- one-hundreds and A- one-hundreds before that to all these cloud providers.
- ▶ 1:15:21 Ben Gilbert It's the successor to the A-One hundred.
- ▶ 1:16:21 Ben Gilbert So, the reason you want an H-one hundred is they're 30 times faster than an A-one hundred, which mind you is only like two and a half years older.
- ▶ 1:17:20 Ben Gilbert It's got meaningfully higher energy usage than the A-one hundred.
- ▶ 1:21:53 David Rosenthal So today, like we've been saying, if you want to use H-one hundreds and A-one hundreds, say you're an AI startup, the way you're probably going to do that is you're going to go to a cloud, either a hyperscaler or a dedicated GPU cloud like…
- ▶ 1:22:24 Ben Gilbert That's eight A 100 for about 30 bucks an hour, or you can go over to AWS and get a P five dot 48 X large instance, which is eight H 100, which I believe is an HGX server for about a hundred dollars an hour.
- ▶ 1:25:19 David Rosenthal So starting price for DGX Cloud is 37,000 dollars a month, which will get you an A-one hundred based system, not an H-one hundred based system.
- ▶ 1:25:36 David Rosenthal A listener helped us out and estimated that the cost to actually build an equivalent A-one hundred DGX system
- ▶ 1:48:33 Ben Gilbert The land of A-Hundreds.
- ▶ 1:49:31 David Rosenthal As part of that, NVIDIA can no longer sell their top-of-the-line H-one hundreds or A-one hundreds to anybody in China.
- ▶ 1:50:34 Ben Gilbert Get them while I still can, these A-Hundreds.
- ▶ 2:15:24 Ben Gilbert There are so many people that are using A-One-Hundreds right now.
- ▶ 2:15:27 Ben Gilbert And in fact, most workloads can be run on A-Hundreds unless you're doing model training of GPT-IV.
Costco (Audio) · Acquired
- ▶ 1:40:17 Ben Gilbert Literally, their data centers are nothing but rows and rows of the latest NVIDIA A-Hundreds and H-Hundreds, so they have the benefit of focus and specialization.
Nike (Audio) · Acquired
- ▶ 1:08:22 Ben Gilbert A 100 and H 100.
Nvidia: The Machine Learning Company (2006-2022) · Acquired
- ▶ 1:07:03 Ben Gilbert It's not the A-one hundred, it's the H-one hundred.
- ▶ 1:07:05 David Rosenthal Uh, so the A-one hundred, they just announced the H-one hundred.
- ▶ 1:10:11 Ben Gilbert Like, the a-one-hundred does not have video out, so they actually can't be used as graphic cards.
- ▶ 1:10:17 David Rosenthal Oh yeah, there was a, there's a cool, um, Linus Tech Tips video about this where they get a hold of an A-one hundred somehow, and then they run some benchmarks on it, but they can't actually, like, drive a game on it.