publicly available models
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jul 28, 2025 by Kevin Hou · across every show →
Everything said about publicly available models, oldest first
Jul 28, 2025 bearish
Hou: Public retrieval models underperform on git commit benchmarks
“We threw some of the currently publicly available models at this notion of retrieval, this idea of using commit messages, and we found that there is reduced performance. They're unable to reason over specifically code, but then also specifically this kind of r…”