AI Compute Efficiency
topic on 2 shows · 2 statements across 2 episodes
the Y Combinator Startup Podcast
All-In
2 statements about AI Compute Efficiency, every show
Friedberg: AI compute efficiency will improve 70x to 100x within years
“I do think that we will see compute efficiency scale by probably on the order of 70 to a hundred X over the next few years, meaning electricity efficiency per token of output.”
Kaplan: AI training and inference will see 3x-10x yearly efficiency gains
“I think that over time, as AI becomes more and more widespread, I think that we're going to really drive down the cost of inference and training dramatically from where we are right now. Sort of, three X to 10 X gains algorithmically, and in sort of scaling up…”