Mike Krieger says AI products should measure task completion, not engagement
Mike Krieger · Anthropic's CPO on what comes next | Mike Krieger (co-founder of Instagram) · Jun 5, 2025 · at 1:02:06
Mike Krieger, Chief Product Officer at Anthropic and co-founder of Instagram, explains why traditional Web 2.0 engagement metrics do not fit AI products.
0:00 / 0:12exact quote · 12.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I don't have a great answer yet, but I think that like, it's not the web two O or even the social media days, like engagement metrics, you know, it should hopefully really be around Like, did it actually help you get your work done?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Mike Krieger
Mike Krieger estimates Claude Code is over 95% written by AI
“At this point, I would be shocked if it wasn't 95% plus.”
Anthropic's Claude Code team uses Claude to write and review itself
“The team that works in the most futuristic way is the Claude code team, because they're using Claude code to build Claude code in a very self-improving kind of way. And, you know, early on in that project, they would do very line by line pull request reviews, …”
Mike Krieger expects AI to autonomously resolve user feedback by 2025
“Hey, I'm in the discord, the, you know, the, Cloud anthropic discord. I'm in the user for I'm on X and I'm reading things and like, here's what's emergent. That's step one. Models can do that today. Step two, which the models probably can do today. We just hav…”
Mike Krieger says MCP is more promising for agents than computer use
“To really have agency and have these agentic use cases. Like one way you approach it is computer use, but computer use has a bunch of limitations. The way I get way more excited about everything is an MCP and our models are really good at using MCPs. All of a …”
Krieger: AI benchmark evals often contain flawed ground-truth answers
“And some of these model these evals we've seen, like, even the golden answer, I'm like, I'm not sure a human would say it, or, like, I think that math is actually a little wrong, like, getting a hundred percent is gonna be really hard, because even just gradin…”
Mike Krieger uses Claude Opus 4 as his primary strategy partner
“Where my go-to product strategy partner is Claude, and it has been basically for that full year where I'll write an initial strategy. I'll share it with Claude basically, and I'll have it, you know, look at it. And in the past, it's pretty anodyne kind of comm…”