Dianne Penn
Head of Product, Anthropic. On 1 show, 1 appearance. The Shows tab opens the full record on each.
operatorexecutiveLinkedIn ↗anthropic.com ↗
Penn joined Anthropic in 2023 as its first technical product manager, helping ship models from Claude 2 through Fable and incubating features including Claude Code and computer use. She previously worked on Alexa's AI team at Amazon and held roles at Credit Karma, McKinsey, and JPMorgan Chase.
1shows
1appearances
26statements
2resolved
1supported
1contradicted
50%fully supported
Everything Dianne Penn said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Penn: Scaling loss is smooth, but AI capabilities emerge discontinuously
“As you add in more compute and data, what's called loss, aka the loss from next token prediction goes down. And so it's a very smooth linear curve of, like, the models get more intelligent as you scale them up. What's actually also interesting in that paper is…”
Penn: Evals Have Replaced Traditional PRDs in AI Product Management
“We actually have a saying on the team of evals are the new PRDs. Cause in order to deliver that user value it's not that exact artifact that people used to write in the last like one to two decades. It's a new way of working.”
Penn: Optimizing Claude 3 Opus for long-form coding drove Anthropic's early differentiation
“People are starting to use code these models, not just for code, not just like code autocomplete, but actually writing long form code. And it's that an opportunity for us to train, you know, Opus three to be better at. And it ended up being a relatively smalle…”
Penn: Opus 4.5 and Claude Code depended on each other for breakout success
“I think Opus Four Five wouldn't have had that moment without a product like Cloud Code. And Cloud Code, I think, wouldn't have had that type of adoption accelerated without Opus Four Five.”
Penn: Anthropic's Opus and Fable models still have product overhang
“I think there's like product overhang and user overhang, like to maybe put it in our PM language, even on today's models. And I think there's like a lot that we could be exploring on like our current opuses and definitely with like Fable, for example”
Penn: Highly capable AI models increase the need for user-centric PMs
“I think fundamentally, you didn't ask me this, but there is this question in the community of, do we still need PMs when the models are still capable, when engineers are leaning in I think the role of people who are user centric, who go into the details of und…”
Penn: Golden Gate Claude was Anthropic's hidden product inflection point
“That to me was like one of those, like maybe hidden inflection points of we were starting to find our identity, that we could build products, build experiences that were different for what our competitors had seen, what was already out there.”
Penn: Users need frontier product harnesses to feel frontier model magic
“One thing we say a lot on the team is you need frontier products in order to have frontier models and for people to feel the magic. Of frontier models.”
Penn: Telling AI researchers Claude hallucinated is unactionable without failure-mode breakdowns
“If you bring that to a researcher and you say, please fix Claude from being hallucinated, it's not very actionable. And so part of the time of the team is understanding, okay, what's the trajectory of why that user gave that feedback?”
Penn: Anthropic Kept Research PM Hiring Process Unchanged for Three Years
“We actually on my team have not changed our hiring loop for three years now. So what we actually look for and the traits and how we evaluate generalists like PNs, generalists like research product managers have actually been the same.”
Penn: AI PMs Must Sweat Tokens as Much as Pixels
“Here, you have to sweat the tokens as much as you sweat the pixels. And so one activity we have on the team is reading the transcripts. And understanding, ah, what was the trajectories that failed?”
Anthropic creates a PRD for every AI model it develops
“So when we do have a model, we actually, for every model, we do have a PRD. Less necessarily for our researchers, but more for our growing product surfaces, for our engineering teams, for our stakeholders like legal and safety and others as just a source of tr…”
Penn: Useful AI models push back on unformed ideas rather than agree
“What you don't want is like a AI that just agrees with you, right? What you want is this technology to actually augment and grow and like get to a better outcome. And so sometimes it's Having Claude push back makes me better, and so that's great. Like a cowork…”
Penn: Anthropic uses research Opus models to determine future Claude pricing
“So I've used Claude to help with things like, are we making the right pricing decision on the next version of Claude? It's a little bit meta, but using a research version of Opus, asking it to figure out how is your price and being able to come out with better…”
Penn: Human judgment will stay critical as AI lacks human experience
“I think judgment is one, is an area where it's accumulation of so much nuance and so much experience, and these systems haven't experienced as much as humans have. And so I think that hard earned, like, judgment Is a area for product leaders and just generally…”
Penn: AI in biology and life sciences is only at foot of exponential
“I think, you know, software engineering has been really transformed by AI. I think there's areas like biology, life sciences. These are all things that we're just kind of at like the foot of the exponential on. Like, maybe software engineering were on the expo…”
Penn: Anthropic had five product engineers and one API engineer in 2023
“So I joined in 20, 23. Like you said, we had five product engineers. There was one engineer for the entirety of our API business, if you believe.”
Penn: Anthropic Labs incubated Claude Code, Skills, Claude Design, and MCP
“Things like cloud code things like skills, and most recently cloud design, MCP.”
Penn: Anthropic discussed computer use for Claude at founding
“I think even at the founding of the company, researchers were talking about how do we get clawed to you? Use a computer. How do we get AI to, like, navigate a screen, right?”
Anthropic Research Leaders Personally Inspect Training Runs and Evals
“Our like leadership, our chief scientists, our heads of like fine tuning and like RL folks are actually really close to the training runs and actually look at things like how the training run is going, evals, looking at the underlying data.”
Penn: Design AI products for forward compatibility with future Claude models
“One thing I asked the team frequently or how I think about when we're building a product is let's say Claude eight comes around. What do you, what changes in what users do? And then what should, what does that mean for how you're building today? Is it going to…”
Penn: 80% of early Claude instruction failures were invalid JSON outputs
“And what I saw was something like 80% of what people meant in the early days for this failure was Claude would not write the right JSON.”
Penn: Claude scores 99.9% to 100% on JSON schema formatting evals
“When we have versions of Claude, we actually run that eval and just check. I think at this point it's always a hundred percent or like 99.9. And so it's no longer a pain point.”
Penn: Built Claude skill using Crucial Conversations to coach management conversations
“I don't think it's necessarily just about raising the IQ of like experiences we build, but also I use it a lot and actually like prepping for how to have better conversations in the moment during like crucial conversations. So I love that book. And so I actual…”
One line per show, most statements first. The link opens Dianne's full record on that show: the calibration, argument clarity, speaking style and every statement made there.
| Show | Role there | Eps | Statements | Record | |
|---|---|---|---|---|---|
 LENNY'S PODCASTLEDGER | Head of Product, Anthropic | 1 | 26 | 50% 1/2 | full record on Lenny's Podcast → |