Nvidia's BF16 Efficiency Barely Improves Across Hopper, Blackwell, and Rubin
“If you look at, you know, Hopper to Blackwell to Rubin, and you compare like for like, what is the performance per watt of a beefload-sixteen multiply? It hasn't improved all that much.”
Baker: Wall Street models hyperscaler Blackwell compute monetizing at Ampere rates
“If you look at the amount of gigawatts that are supposed to come on, and consensus estimates for hyperscalers, they're effectively modeled, and these are gigawatts of Blackwell and Rubin. Rubin being NVIDIA's next chip, Blackwell being the current chip. They a…”
NVIDIA Rubin will shift inference engineering toward traditional hardware infrastructure challenges
“I think that themes around like KV cache offloading, KV aware routing, and disaggregation are going to be substantially more important in the Rubin era, which means that inference engineering becomes not just a like CUDA kernel problem, but also like a very tr…”
NVIDIA's Rubin is the first GPU architecture designed entirely for modern LLMs
“Ruben's honestly the first chip that was fully built in that world. And so you can see a lot of the understanding of the shape of the workload that this chip's going to be asked to do in the way it's designed.”
NVIDIA announces Rubin CPX as a dedicated prefill-specific hardware accelerator
“And like with our future generations, generations of hardware, we actually announced like with Rubin, this new accelerator that is pre-fill specific. It's called Rubin CPX.”
Nvidia's Rubin architecture will significantly widen its lead over custom ASICs
“And then when Rubin comes out, we'll know the gap. The gap is going to expand significant versus TPUs versus TPUs and all other ASICs.”
Financial economics will dictate AI capital spending over hyperscaler prisoner's dilemmas
“But with Blackwell, and for sure with Rubin, economics are going to dominate the prisoner's dilemma from a decision making and spending perspective, just because the numbers are so big.”
Huang: NVIDIA could not design Hopper, Blackwell, or Rubin chips without AI agents
“Our cyber security system today can't run without Without our own agents. We have agents helping to design chips. Hopper wouldn't be possible. Blackwell wouldn't be possible. Ruben don't even think about it.”