Weak Language Models
topic on 1 show · 1 statements across 1 episodes
1 statements about Weak Language Models, every show
Morcos: Weak models can rephrase data to train superior models
“Because the model that's doing the rephrasing just needs to know how to rephrase.
It doesn't need to know anything about the content itself.
It doesn't need to understand it.
It means you can use a pretty weak model.
To do the rephrasing and have it generalize…”