superposition hypothesis
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jun 6, 2025 by Emmanuel Ameisen · across every show →
Everything said about superposition hypothesis, oldest first
Jun 6, 2025 neutral
Ameisen: Superposition is more severe in language models than in vision models
“That means that like language models pack a lot more in less space than Vision models. So maybe like a kind of like really hand wavy analogy, right? It's like, well, if you want curve detectors, like you don't need that many curve detectors. You know, if each …”