production
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jan 11, 2026 by Aishwarya Reganti (Ash) · across every show →
Everything said about production, oldest first
Jan 11, 2026 negative
Reganti: Predefined AI evals only catch anticipated failure patterns
“The issue with just building a bunch of evaluation metrics and then having them in production is evaluation metrics catch only the errors that you're already aware of, but there can be a lot of emerging patterns that you understand. Only after you put things i…”