TPU

“They are very much successful inside of Google, but not much outside of Google, let's say, right?”

“But AMD can do training, but it's also, but in terms of maturity, the, by far the most mature software and compute is TPUs, and then it's Nvidia.”

“I think that if you are doing it bottom up, infra to applications, you will lose because nobody will care. As they don't today, right? If you look at TPUs, they're available, they're great. Nobody cares.”

“So, people look at the TPU as a big success, and what they don't realize is that there were about three chip efforts at Google at the same time and only one of them ended up outperforming GPUs.”

“The idea that NVIDIA is unstoppable because of the software and hardware connection, because we have to have GPUs. I know there's a lot of truth to that, but literally as an end user, I went right back and forth to them today. No, no issue. TPUs, GPUs, LLMs, a…”

“Anthropic signed a deal for a million TPUs, right? And is deep on the whole Amazon Tranium ecosystem.”