Krieger: Best product managers rapidly prototype UI designs directly using AI models
Mike Krieger · A conversation with OpenAI's CPO Kevin Weil, Anthropic's CPO Mike Krieger, and Sarah Guo · Nov 6, 2024 · at 19:04
Mike Krieger (CPO, Anthropic) discusses essential skills for modern AI product managers, sharing how PMs and engineers at Anthropic use Claude to rapidly mock up user interfaces.
0:00 / 0:31exact quote · 31.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think prototyping with these models is a thing that is underused. Like, our best PMs do this, where we'll get in some long conversation about, like, should the UI be this or that, and before our designers have even, like, picked up their Figma, like, our, often our PMs, or sometimes our engineers will be like, great, I prompted Claude, I did, like, an AB comparison of what these two UIs could look like, let's try them, and I'm like, oh, this is really cool, and, like, play that out, and, like, we'll be able to prototype much, like, a far greater variety and evaluate Like on a much faster scale than before.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Mike Krieger
Mike Krieger estimates Claude Code is over 95% written by AI
“At this point, I would be shocked if it wasn't 95% plus.”
Anthropic's Claude Code team uses Claude to write and review itself
“The team that works in the most futuristic way is the Claude code team, because they're using Claude code to build Claude code in a very self-improving kind of way. And, you know, early on in that project, they would do very line by line pull request reviews, …”
Mike Krieger expects AI to autonomously resolve user feedback by 2025
“Hey, I'm in the discord, the, you know, the, Cloud anthropic discord. I'm in the user for I'm on X and I'm reading things and like, here's what's emergent. That's step one. Models can do that today. Step two, which the models probably can do today. We just hav…”
Mike Krieger says MCP is more promising for agents than computer use
“To really have agency and have these agentic use cases. Like one way you approach it is computer use, but computer use has a bunch of limitations. The way I get way more excited about everything is an MCP and our models are really good at using MCPs. All of a …”
Krieger: AI benchmark evals often contain flawed ground-truth answers
“And some of these model these evals we've seen, like, even the golden answer, I'm like, I'm not sure a human would say it, or, like, I think that math is actually a little wrong, like, getting a hundred percent is gonna be really hard, because even just gradin…”
Mike Krieger uses Claude Opus 4 as his primary strategy partner
“Where my go-to product strategy partner is Claude, and it has been basically for that full year where I'll write an initial strategy. I'll share it with Claude basically, and I'll have it, you know, look at it. And in the past, it's pretty anodyne kind of comm…”