performance evals
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement May 23, 2025 by Scott Clark · across every show →
Everything said about performance evals, oldest first
May 23, 2025 negative
Clark: High-level LLM evaluations mask undesired AI system behaviors
“We're seeing people do the exact same thing again today with LLMs, where they're focusing on these high-level metrics, these end outputs, these performance evals, and that ends up masking all of these potentially undesired behaviors within the system itself.”