GPU

“The way that he described it to me, which is so true the minute he said it, I was like, my gosh, it's like Moore's law never ended, it just shifted to GPUs.”

“What you really see is that if you think about, you know, supercomputing power, so the ability to get to an answer that has actually continued unabated. And if you look at this chart, the reason why this is possible is entirely because we've shifted from CPUs …”

“We have a GPU shortage and it's probably not going to get better for a year or two, if that.”

“We're going to run out of GPUs, accelerators, compute in 2025, the same way we did in 23.”

“But if China, if one day China had 10 XR power capacity, it won't even matter, right? Because they'll just have so many more, whether they're not quite the same advanced GPUs or not, they'll just have so many more of them. Their industrial AI capacity will be …”

“I don't necessarily see the AI, you know, designing our next generation GPU. But I do see it helping us design the next generation GPU much faster and more reliably, so.”

“There's not going to be a dark GPU in the world next year.”

“Like today, there's a five silica model, which is completely resident using NPUs and of course using GPUs.”

“There's no such thing as a dark GPU right now. Every GPU that's been put in a data center is getting used and it's being used to generate tokens.”

“The GPU, for example, has a lot of capacity of memory, but it's really slow. All right, and that's a huge bottleneck in inference. It's why they can't be fast.”

“We use a six year depreciation. We believe that the GPUs will last in excess of six years, but we felt like that was a fair and reasonable approach to a technology cycle that's moving at this velocity.”

“There are no idle GPUs in the world sitting in a data center.”

“There's no dark GPUs today, as you know, Brad Gerstner likes to say.”

“All GPUs use Grok or Cerebrus for decode, and then those older GPUs, they have a useful life for 10 or 15 years, and this means that you can finance GPUs.”

“So when OpenAI uses us, we're 15 or 18 times faster than a GPU.”