AI model architecture
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Nov 20, 2025 by Luca Soldaini · across every show →
Everything said about AI model architecture, oldest first
Nov 20, 2025
Soldaini: Flawed long-context model architecture cannot be saved by good data
“But they're like technical decisions in how you set up your model that you can have the best data in the world. And your model will not be able to reason over many, many tokens. So it doesn't matter in the sense that you can't train the model on bad data, but …”