Superposition Hypothesis
topic on 1 show · 1 statements across 1 episodes
1 statements about Superposition Hypothesis, every show
Ameisen: Superposition is more severe in language models than in vision models
“That means that like language models pack a lot more in less space than Vision models. So maybe like a kind of like really hand wavy analogy, right? It's like, well, if you want curve detectors, like you don't need that many curve detectors. You know, if each …”