Garman: NVIDIA treats AWS very fairly in allocating GPU supplies
Matt Garman · AWS CEO Matt Garman on Amazon's Big AI Chips Bet, Working With OpenAI, and Nuclear Energy · Dec 5, 2024 · at 13:50
Alex Kantrowitz asks if AWS must jostle with tech leaders like Elon Musk and Mark Zuckerberg to secure scarce NVIDIA GPUs.
0:00 / 0:04exact quote · 4.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“They're very fair in dealing with us and we give long-term forecasts and they tell us what they can supply.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Matt Garman
Garman: Expecting one dominant AI model is a fundamentally flawed premise
“And this is where a lot of people started, and I just think it's fundamentally the wrong way of thinking about it. Which is a lot of times people are thinking about there's just going to be this one model and I want to have the one model that's going to be the…”
Garman: AWS is open to hosting OpenAI and Google Gemini models
“We're always open to having OpenAI be available in AWS someday, or having Gemini models be available in AWS someday, and maybe someday we will spend more time focused on our own models, for sure.”
Garman: Trainium 2 Delivers 30% to 40% Better Price-Performance Than GPUs
“We see 30 to 40% price performance games versus our instances that are GPU powered today.”
Garman: AWS automated reasoning mathematically eliminates AI hallucinations in bounded domains
“So by that, by this kind of mechanism, you're, like, systematically able to actually mathematically prove that you got the right answer coming out of this and completely eliminate hallucinations for that area, right? It doesn't mean that we've eliminated hallu…”
Garman: Small modular nuclear reactors will be major energy sources starting 2030
“We do think that you know, over the next probably starting somewhere in, in 20, 30 and beyond these small modular reactors, which is what X-energy builds, are gonna be a huge component of this.”
Garman: AWS Project Rainier will deploy hundreds of thousands of Trainium2 chips in 2025
“We're building together with them what we call Project Rainier and so it's using our next generation Tranium II chips, and this cluster that we're building for them in twenty-twenty-five will be five times the size, the number of exaflops that they use to trai…”