Academic AI evals
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 15, 2025 by Brendan Foody · across every show →
Everything said about Academic AI evals, oldest first
Sep 15, 2025 negative
Academic AI benchmarks are wholly disconnected from enterprise needs
“One of the largest inefficiencies in all of AI research is that the evals that people have been going on Of humanity's last exam and PhD level reasoning or Olympiad math are wholly disconnected from the outcomes that consumers and enterprises actually care abo…”