Academic AI Evals
topic on 1 show · 1 statements across 1 episodes
1 statements about Academic AI Evals, every show
Academic AI benchmarks are wholly disconnected from enterprise needs
“One of the largest inefficiencies in all of AI research is that the evals that people have been going on Of humanity's last exam and PhD level reasoning or Olympiad math are wholly disconnected from the outcomes that consumers and enterprises actually care abo…”