parameter space
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Feb 12, 2026 by Jeff Dean · across every show →
Everything said about parameter space, oldest first
Feb 12, 2026
Dean: Memorizing retrievable facts wastes model parameter space
“Having the model devote precious parameter space to remembering obscure facts that could be looked up is actually not the best use of that parameter space, right? Like you might prefer something that is more generally useful in more settings than this obscure …”