Parameter Space
topic on 1 show · 1 statements across 1 episodes
1 statements about Parameter Space, every show
Dean: Memorizing retrievable facts wastes model parameter space
“Having the model devote precious parameter space to remembering obscure facts that could be looked up is actually not the best use of that parameter space, right? Like you might prefer something that is more generally useful in more settings than this obscure …”