Penn: Useful AI models push back on unformed ideas rather than agree
Dianne Penn · Why AI is going vertical (again) | Dianne Penn (Anthropic) · Jul 26, 2026 · at 1:03:23
Anthropic Head of Product Dianne Penn discusses the value of AI alignment and safety research in preventing sycophancy.
0:00 / 0:22exact quote · 22.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“What you don't want is like a AI that just agrees with you, right? What you want is this technology to actually augment and grow and like get to a better outcome. And so sometimes it's Having Claude push back makes me better, and so that's great. Like a coworker, I want somebody to push back when my ideas are not fully formed.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dianne Penn
Penn: Scaling loss is smooth, but AI capabilities emerge discontinuously
“As you add in more compute and data, what's called loss, aka the loss from next token prediction goes down. And so it's a very smooth linear curve of, like, the models get more intelligent as you scale them up. What's actually also interesting in that paper is…”
Penn: Evals Have Replaced Traditional PRDs in AI Product Management
“We actually have a saying on the team of evals are the new PRDs. Cause in order to deliver that user value it's not that exact artifact that people used to write in the last like one to two decades. It's a new way of working.”
Penn: Optimizing Claude 3 Opus for long-form coding drove Anthropic's early differentiation
“People are starting to use code these models, not just for code, not just like code autocomplete, but actually writing long form code. And it's that an opportunity for us to train, you know, Opus three to be better at. And it ended up being a relatively smalle…”
Penn: Opus 4.5 and Claude Code depended on each other for breakout success
“I think Opus Four Five wouldn't have had that moment without a product like Cloud Code. And Cloud Code, I think, wouldn't have had that type of adoption accelerated without Opus Four Five.”
Penn: Anthropic's Opus and Fable models still have product overhang
“I think there's like product overhang and user overhang, like to maybe put it in our PM language, even on today's models. And I think there's like a lot that we could be exploring on like our current opuses and definitely with like Fable, for example”
Penn: Highly capable AI models increase the need for user-centric PMs
“I think fundamentally, you didn't ask me this, but there is this question in the community of, do we still need PMs when the models are still capable, when engineers are leaning in I think the role of people who are user centric, who go into the details of und…”