offline evaluation
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jan 10, 2025 by Mario Rodriguez · across every show →
Everything said about offline evaluation, oldest first
Jan 10, 2025
GitHub CPO: AI Experimentation Is Useless Without Over-Investing in Offline Evals
“At GitHub we invest in this thing we call coffee, which is compiler offline evaluation, and that's one area that I have found to be a place that you have to over invest in AI if you will, if you need to experiment, because you could experiment all day in AI an…”