Inference Time Search
topic on 1 show · 1 statements across 1 episodes
1 statements about Inference Time Search, every show
Polosukhin: Internal knowledge search beats external search at inference time
“The fact that this model is, like, doing a really effective search in kind of this knowledge space means that probably, like, pushing more into that concept is more useful than doing more searches at inference time because, like, it means you already lost all …”