StarZero All shows Try the podcast clipper →

SWE-bench

also referred to as: swe bench

2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Jul 21, 2025 by Alex Kantrowitz · said 9 times in 6 episodes since 2024 · across every show →

Mentions by year

brought up most by Amjad Masad (4), Swami Sivasubramanian (1), Mike Krieger (1), Dario Amodei (1), Brad Lightcap (1), Alex Kantrowitz (1)

tap a year for its mentions
00438520242025episodesmentions
03520242025episodes it came up in
0012.52520242025episodesmentions per episode
2025 8 mentions in 5 episodes 2 per episode
2024 1 mention in 1 episode

every mention, scene by scene, with the transcript →

Everything said about SWE-bench, oldest first

Jul 21, 2025 bullish
Assertion Supported
Kantrowitz: Kimi K2 Scores 65.8 on SWE-Bench, Trailing Claude 4 Opus
“Claude IV Opus gets a 72.5 on that. Kimi K-II gets 65.8, so not far behind. And just to, you know, give some context, Deep Seek V-III, which everybody was going crazy over, gets a 38.”
Alex Kantrowitz Jul 21, 2025 ▶ 45:32 Grok's AI Lovebot, Aqui-Hire-Sition Backlash, OpenAI's ChatGPT Agent Debuts
Aug 11, 2025 bullish
Assertion Supported
Masad: AI SWE-bench scores jumped from 10% to 80% in a year
“I don't know, I think we were at, like, 10% last year, and now we're at, like, 70% and 80%.”
Amjad Masad Aug 11, 2025 ▶ 42:06 Vibe Coding: Everything You Need To Know — With Amjad Masad
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more