codebase understanding
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Apr 2, 2025 by Guy Gur-Ari · across every show →
Everything said about codebase understanding, oldest first
Apr 2, 2025 bearish
Gur-Ari: SWE-bench fails to effectively test true codebase understanding
“What we found with SuiteBench is an interesting benchmark, very useful for doing some things like refining prompts, for example, and trying out different tools. Specifically for codebase understanding, in the beginning, we were hopeful That it will tell us mor…”