MLE-bench, every mention

3 scenes · ← back to MLE-bench

tap a year for its mentions
00112120242025episodesmentions
01120242025episodes it came up in
0010.52120242025episodesmentions per episode

every year anyone Jesse Hu 2Shawn Wang 1

Verbatim, from the transcripts: the passages where MLE-bench comes up

loading…

2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents Jan 1, 2025 · 1 mention

  • ▶ 1:07:58 Shawn Wang OpenAI also has MLE bench, which is more tracking sort of ML research and bootstrapping, which arguably like this is the key metric that is most relevant for the frontier labs, which is when the researchers can automate their own jobs.

[Paper Club] SWE-Bench [OpenAI Verified/Multimodal] + MLE-Bench with Jesse Hu Oct 19, 2024 · 2 mentions

  • ▶ 42:55 Jesse Hu Um, so the final paper, and this came out really recently as MLE bench, and so this is, I think, coming from sort of like the insane open AI thesis about how AI then creates AI, accelerates the whole thing to AGI, ASI, um, but in a very…
  • ▶ 55:29 Jesse Hu On MLE bench?
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.