Claude 3.7 Sonnet

also referred to as: claude 3.7

part of Claude

11 statements across 9 episodes · 6 bullish · 3 bearish · 8 people on the record · first statement Mar 4, 2025 by David Hershey · said 54 times in 21 episodes since 2025 · across every show →

Mentions by year

brought up most by Pratik Bhavsar (7), Alessio Fanelli (6), Will Brown (5), Kat Wu (3), David Hershey (3), Thorsten Ball (2), Sujay Jayakar (2), Sarah Sachs (2)

tap a year for its mentions
002510502020252026episodesmentions
0102020252026episodes it came up in
001.51032020252026episodesmentions per episode
2026 9 mentions in 4 episodes 2 per episode
2025 45 mentions in 17 episodes 3 per episode

every mention, scene by scene, with the transcript →

Everything said about Claude 3.7 Sonnet, oldest first

Mar 4, 2025 bullish
Prediction Not checkable as stated
Claude 3.7's error-correction capabilities will enable better real-world AI agents
“I really do think like this is just demonstrating like a thing that is going to make agents better with this model, you know, like This is a very fun way to see it, but, like, I think the thing is that it, like, has some ability to, like, course correct, updat…”
David Hershey Mar 4, 2025 ▶ 35:39 How Claude Plays Pokémon was made
Mar 4, 2025 positive
Assertion Not checkable as stated
Claude 3.7 Sonnet uniquely generates meta-commentary reflecting on its perceptual errors
“And actually like one of the things that's most unique about. 3.7 sonnet that I've seen is like, it will have like meta commentary on what it's good at and bad at and it's knowledge base. Like I misperceived this thing. And so like, I need to be careful doing …”
David Hershey Mar 4, 2025 ▶ 26:23 How Claude Plays Pokémon was made
Mar 19, 2025 negative
Assertion Not checkable as stated
Claude 3.7 performed worse than Claude 3.5 on Convex evals
“For example, we just tried clod three seven and it performs worse than clod three five on convex evals with the same prompting.”
Sujay Jayakar Mar 19, 2025 ▶ 17:23 Fullstack-Bench: The Eval for Coding Agents — with Sujay Jayakar, Chief Scientist, Convex
Apr 2, 2025 positive
Assertion Not checkable as stated
Sequential Thinking MCP outperformed Claude 3.7 native reasoning mode in evaluations
“We tried reasoning mode as well with the new three seven. And we didn't see that much of a bump in performance. We don't know if this is something that's code specific or not. I don't have an insight. We tried both and yeah, sequential thinking worked better.”
Guy Gur-Ari Apr 2, 2025 ▶ 3:57 The #1 SWE-Bench Verified Agent
Apr 5, 2025 negative
Assertion Not checkable as stated
Hershey: Claude 3.7 extended thinking does not help Pokémon gameplay
“I've tested, like, all sorts of the extended thinking mode with, ah, 3.7 on it, and, like, it doesn't really help.”
David Hershey Apr 5, 2025 ▶ 14:01 Claude Plays Pokémon Hackathon: Escape from Mt. Moon!
Apr 21, 2025 bullish
Assertion Supported
Packer: Sleep-time compute offers Pareto improvements across Claude 3.7 and DeepSeek
“It's like pretty consistent across like both 3.7 deep seek, three mini, which all like the way you actually scale the x-axis here is fundamentally quite different in each case with 3.7 extended thinking mode. The parameter you provide to scale it is different …”
Charles Packer Apr 21, 2025 ▶ 26:27 Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)
May 7, 2025 neutral
Insight
Wu: Claude 3.7 Sonnet is highly persistent but interprets tasks too literally
“The latest Sonnet three seven is, it's a very persistent model. It's like very, very motivated to accomplish the user's goal, but it sometimes takes the user's goal very literally, and so it doesn't always fulfill what, like, the implied parts of the request a…”
Kat Wu May 7, 2025 ▶ 54:58 Claude Code: Anthropic's CLI Agent
May 23, 2025 neutral
Opinion
Brown: Claude 3.7 works for quick projects, not large codebases
“I never really got to the point where I found it was helpful for a thing that was like a large existing code base. But if it's like, hey, I want to like cook something up in a few hours for fun. Pretty good at that. But these become messy and they become hard …”
Will Brown May 23, 2025 ▶ 17:26 ⚡️Multi-Turn RL for Multi-Hour Agents — with Will Brown, Prime Intellect
Jul 14, 2025 bullish
Assertion Contradicted
Claude 3.7 remains unbeaten on Galileo Agent Leaderboard
“When we released the leaderboard and just in a week that launched 3.7, And that went straight up, and nobody has beaten it so far.”
Pratik Bhavsar Jul 14, 2025 ▶ 10:58 ⚡️Ranking Agentic LLMs — Pratik Bhavsar, Galileo
Jul 14, 2025 negative
Opinion
GPT-4o Mini cannot accurately evaluate complex Claude 3.7 outputs
“GPD for a mini can't find, ah, cannot evaluate the hard outputs that's 3.7 might be doing correctly, right?”
Pratik Bhavsar Jul 14, 2025 ▶ 23:12 ⚡️Ranking Agentic LLMs — Pratik Bhavsar, Galileo
Jul 28, 2025 bullish
Assertion Not checkable as stated
Hou: Users choose SWE-1 at higher frequencies than Claude 3.7 and 3.5
“People are choosing SWE-ONE because it recognizes how they do work, not necessarily how to generate code. And it's contributing, actually, an even higher frequency than models like 3.7 and 3.5.”
Kevin Hou Jul 28, 2025 ▶ 3:31:45 🕰️ The Oral History of Windsurf (ft. Varun Mohan, Scott Wu, Jeff Wang, Kevin Hou, Anshul R)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.