GPU

“We might see GPU spike in demand, you know, Cause that to increase in price for the time being, but I think that's just a moment in time for right now.”

“We're starting to build out our first local data center. And for our own GPUs, both for the geometric rendering side and the ML training side, we use those on both sides of the stack there.”

“Microsoft is still compute constrained. And they project, I think, all the way through twenty-twenty-five, they'll still be needing to buy GPUs aggressively because it just cannot serve service all of the demand.”

“With that, we should be able to generate extremely precise data in otherwise unexplored territory of chemical space of material space and use that data to drive to train a conventional machine learning system. I think through that kind of mechanism, we can Pro…”

“And if you look at Instagram time spent, basically it was flat for, I don't know, maybe 18 months to six months ago. And now, you know, you would spend 40 minutes a day, and now that's gone up like 15% in just the past six months, because they basically took t…”

“None of this is physically realizable, right? That's what's really kind of annoying to me. I'm like, okay, you're talking about, you know, a trillion dollars of GPUs. Where the fuck are you gonna get the power for that? I'm sorry, right? Like you're just, you'…”

“Now, the ratio is actually moving from, to one CPU to four GPUs, and so it's improved kind of by two x already, and we think it actually has a chance to flip the opposite direction, which is one GPU to four CPUs, and so, and some people, very aggressive, say t…”

“They had available capacity because the Grok model wasn't used very much. So they had these GPUs that were sitting around and that's a bad idea. And so they sold a whole block of them or released a whole block of them to Anthropic.”

“Now with these agentic workflows, you actually need both. In fact, the ratio of CPU to GPU is becoming like one to one.”

“The neural network, the benefit of neural network is, it's made up of a lot of standard GMM, general matrix multiplication, which, you know, is a famous, the GPU. GPU is highly optimized for this kind of operation. But the selection tree, you know, the old gen…”