SWE-bench, every mention
5 scenes · ← back to SWE-bench
tap a year for its mentions
every year anyone Harry Stebbings 2Zach Lloyd 1Mike Krieger 1Matt Fitzpatrick 1
Verbatim, from the transcripts: the passages where SWE-bench comes up
Matt Fitzpatrick: Who Wins the Data Labelling Race & Why Al Needs Forward-Deployed Engineers · 20VC with Harry Stebbings
- ▶ 43:47 Matt Fitzpatrick Now, the complexity then becomes if you move from five main benchmarks, like SweetBench and others, to 600 benchmarks, then you kind of lose track of what's doing, who's doing well and which things.
20VC: The Startup Adding $1M ARR Every Week | Competing Against OpenAI's Codex and Claude Code: Who Wins | Why Gemini is Failing and GPT-5 Is Winning | Do Margins Matter in a World of AI | The Ugly Truth About AI Coding with Zach Lloyd, Warp
- ▶ 3:27 Harry Stebbings Warp tops the benchmarks, literally number one on terminal bench, top five on software engineering bench verified, and is trusted by over 600,000 developers.
- ▶ 10:11 Zach Lloyd We run sweet bench.
- ▶ 1:13:10 Harry Stebbings Top five on software engineering bench verified, and is trusted by over 600,000 developers, and used by 56% of the Fortune 500 engineering teams, making it one of the fastest growing AI companies, with revenue growing 30 x this year.
Mike Krieger, Instagram CoFounder & Anthropic CPO: Where Will Value Be Created in an AI World?|E1265 · 20VC with Harry Stebbings
- ▶ 11:31 Mike Krieger There's like, um, it's interesting that we call the, the sort of most, uh, sort of common software engineering thing, SWE bench, right?