compute scaling laws
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Oct 11, 2024 by Alex Kolicich · across every show →
Everything said about compute scaling laws, oldest first
Oct 11, 2024 bearish
LLM scaling exhibits decreasing returns, requiring 10x compute for sublinear improvements
“If you look at it today, though, we are, the exponential in LLM performance is so far working against us that you need Order of magnitude increases in compute, 10 X increase in compute to have relatively sublinear increases in performance. So you're at decreas…”