SweetBench
also referred to as: sweet bench
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jun 5, 2025 by Mike Krieger · across every show →
Everything said about SweetBench, oldest first
Jun 5, 2025 bullish
Anthropic models hit 72% on SWE-bench, crushing earlier timeline predictions
“He's like, I think we'll be at 90% by the end of 20, 25 or something like that. And sure enough, we're at about 72 now with the new models and. We're at 50% when you made that prediction and it's like continued to scale pretty much like as predicted.”