evaluation
also referred to as: evaluations
3 statements across 3 episodes · 1 bullish · 0 bearish · 3 people on the record · first statement Feb 1, 2025 by Karina Nguyen · across every show →
Everything said about evaluation, oldest first
Feb 1, 2025
Nguyen: AI model training requires evals where prompted baselines fail
“Prototype was prompted baseline. It's all, all, everything starts with, like, prompted baseline, and then, like, we craft, like, certain, like, evaluations that we want to, like, capture, that we want to, like, measure progress, at least, for the model, and th…”
Mar 13, 2025
Oct 5, 2025 positive
Agarwal: Rigorous eval suites are core IP for leading AI startups
“The best AI companies will always have to be the edge of what the models can do, right? I think you always want to be threading the line. If everything works all the time, then you're not really pushing the limit and you're not innovating, right? So I think yo…”