Compute Scaling Laws
topic on 1 show · 1 statements across 1 episodes
1 statements about Compute Scaling Laws, every show
LLM scaling exhibits decreasing returns, requiring 10x compute for sublinear improvements
“If you look at it today, though, we are, the exponential in LLM performance is so far working against us that you need Order of magnitude increases in compute, 10 X increase in compute to have relatively sublinear increases in performance. So you're at decreas…”