model weights
2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Jul 2, 2025 by Jack Morris · across every show →
Everything said about model weights, oldest first
Jul 2, 2025 positive
Morris: Weight deltas can reconstruct a competitor's proprietary fine-tuning dataset
“There's some tricks to it, but it's basically just like gradient based selection based on this weight difference. And it seems to be okay. Like it can get us pretty good training data. So I guess if you actually wanted to use this, it would be like your compet…”
Mar 12, 2026 positive
Eskildsen: Model weights compress reasoning, not all world knowledge
“We can take all of the world's knowledge, all of the exabytes and exabytes of data that there is, and we can use those tokens to train a model, but we can't compress all of that into a few terabytes of weights, right? We can compress into a few terabytes of we…”