Publicly Available Models
topic on 1 show · 1 statements across 1 episodes
1 statements about Publicly Available Models, every show
Hou: Public retrieval models underperform on git commit benchmarks
“We threw some of the currently publicly available models at this notion of retrieval, this idea of using commit messages, and we found that there is reduced performance. They're unable to reason over specifically code, but then also specifically this kind of r…”