TPU

“Google is the only company, we talked about the TPU thing, they're the only company with an at-scale ASIC alternative to NVIDIA's GPUs, which should give them a meaningful cost advantage to that end, ah, to the extent that cloud compute becomes commoditized.”

“Google Clouds revenue numbers disappointed, but this was because they didn't have enough GPUs and they were actually constrained. So they missed on top line, like they didn't bring in enough revenue, but their margins actually improved. And so what that means …”

“Google trained Gemini three pro on Google's own TPUs. No mention of Nvidia chips.”

“If TPUs are not for sale, Nvidia does have a monopoly. If Nvidia truly is the only seller in the market because Google is not a seller then yes, they still extract monopoly power from every other buyer because every other buyer says, yeah, I'd love to buy TPUs…”

“Anthropic has ordered twenty-one billion dollars worth of TPUs to train to train large claws.”

“Yeah, so, so for the longest time Google's had, ah, one main line of TPUs, right? All made by Broadcom, and then sort of next year they've diverged it, right? Where Broadcom makes a TPU, ah, and MediaTek makes a TPU. These two TPUs are focused at different thi…”

“Both chief scientists talked about stacking memory right on top of the GPU or TPU, and that's gonna be a huge innovation in the coming months or years.”