construct validity
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement May 14, 2025 by Emily M. Bender · across every show →
Everything said about construct validity, oldest first
May 14, 2025 negative
Bender says most AI benchmarks fail to measure actual capabilities
“Most of the benchmarks that are out there are not reasonable. They lack what's called construct validity, and construct validity is this two-part test of the thing that we are trying to measure is a real thing, and this measurement correlates with it interesti…”