Garman: Cloud Optimization Is Largely Finished, Funding AI and AWS Growth
Matt Garman · AWS CEO Matt Garman on Amazon's Big AI Chips Bet, Working With OpenAI, and Nuclear Energy · Dec 5, 2024 · at 35:21
AWS CEO Matt Garman discusses enterprise cloud spending cycles and why AWS percentage revenue growth has begun to re-accelerate.
0:00 / 0:43exact quote · 43.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Customers, I think number one, a lot of them have been optimized, right? And there's only so much you can kind of squeeze into an Optimize place and customers are still looking for optimizations, but a lot of that work has been done and they're using some of that optimization to help fund some of the new development that they want to do. A lot of that is in the area of AI. Much of that is in the area of migration and modernization where they're moving from on-prem into a cloud world. And so some of those optimizations they did are helping them fund some of that work that's moving more of their workloads to the cloud that's moving and letting them go and build new AI experiences. In AWS. And so that is where we've seen our growth start to come back up as a percentage basis. Some of that is customers leaning into those new experiences and doing some of those more or less modernization migrations.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Matt Garman
Garman: Expecting one dominant AI model is a fundamentally flawed premise
“And this is where a lot of people started, and I just think it's fundamentally the wrong way of thinking about it. Which is a lot of times people are thinking about there's just going to be this one model and I want to have the one model that's going to be the…”
Garman: AWS is open to hosting OpenAI and Google Gemini models
“We're always open to having OpenAI be available in AWS someday, or having Gemini models be available in AWS someday, and maybe someday we will spend more time focused on our own models, for sure.”
Garman: Trainium 2 Delivers 30% to 40% Better Price-Performance Than GPUs
“We see 30 to 40% price performance games versus our instances that are GPU powered today.”
Garman: AWS automated reasoning mathematically eliminates AI hallucinations in bounded domains
“So by that, by this kind of mechanism, you're, like, systematically able to actually mathematically prove that you got the right answer coming out of this and completely eliminate hallucinations for that area, right? It doesn't mean that we've eliminated hallu…”
Garman: Small modular nuclear reactors will be major energy sources starting 2030
“We do think that you know, over the next probably starting somewhere in, in 20, 30 and beyond these small modular reactors, which is what X-energy builds, are gonna be a huge component of this.”
Garman: AWS Project Rainier will deploy hundreds of thousands of Trainium2 chips in 2025
“We're building together with them what we call Project Rainier and so it's using our next generation Tranium II chips, and this cluster that we're building for them in twenty-twenty-five will be five times the size, the number of exaflops that they use to trai…”