External Retrieval
topic on 1 show · 1 statements across 1 episodes
1 statements about External Retrieval, every show
Eskildsen: Model weights compress reasoning, not all world knowledge
“We can take all of the world's knowledge, all of the exabytes and exabytes of data that there is, and we can use those tokens to train a model, but we can't compress all of that into a few terabytes of weights, right? We can compress into a few terabytes of we…”