SWE-bench
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Oct 23, 2025 by Amjad Masad · said 5 times in 3 episodes since 2025 · across every show →
Mentions by year
brought up most by Amjad Masad (2), Ion Stoica (1)
tap a year for its mentions
Everything said about SWE-bench, oldest first
Oct 23, 2025 bullish
Masad: AI SWE-bench scores jumped from 5% to 82% in one year
“Sweebench is the main benchmark used to test whether AI is good at software engineering tasks, and we're almost saturating that. So last year we're at like maybe five percent early 24 or less, and now we're like 82% or something like that with cloths on at 4.5…”