AI training

“It will make training more expensive because instead of just doing one backward pass, you now potentially have to do many forward passes because at each forward pass, you're going to come up with some output. Then the model has to decide which of those outputs…”

“The key constraint with energy is not necessarily, is there enough energy in the world, but more so for training, is there enough energy in one place?”

“I certainly understand the urge for people to see the numbers being spent on training and be concerned that it's not going to recoup in value, but I think that Those numbers are actually small relative to the long-term value that the technology will deliver.”

“So there's really no difference between training infrastructure we deployed to build those capabilities and what our customers are ultimately using to serve them.”

“Six months ago, I would have said it was two-thirds training and one-third inference. It's probably close to fifty-fifty now.”

“The failure rates of GPUs used so intensively for training purposes are much higher than inference specific usage.”