masked language modeling
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement May 4, 2023 by Kelvin Guu · across every show →
Everything said about masked language modeling, oldest first
May 4, 2023
Guu: REALM Rewarded Document Retrieval That Improved Masked Token Predictions
“And the way Realm was being trained in this method was we would say, okay, you can go and you can retrieve some documents. And if those documents help you fill the blank better, learn that those are useful. And if they don't help you fill the blank better, the…”