StarZero All shows Try the podcast clipper →

Jul 6, 2022 · 34m · 20product

20 Product: The Ultimate Guide to Product Reviews: What Makes the Best vs the Worst | How Often Should They Be | Who Should Be Invited | Who Sets The Agenda | How to do Follow-Ups Post Product Reviews

compilation · excluded from per-person scoring

Kayvon Beykpour · 9m spoken Scott Belsky · 7m spoken Harry Stebbings · 6m spoken Aparna Chennapragada · 5m spoken Tony Fadell · 2m spoken Lenny Rachitsky · 2m spoken
0:00 / 0:00

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

This masterclass compilation episode of 20 Product features leading product executives—including Scott Belsky, Tony Fadell, Aparna Chennapragada, Lenny Rachitsky, and Kayvon Beykpour—sharing actionable frameworks for conducting high-impact product reviews. Host Harry Stebbings synthesizes expert perspectives on structuring review stages, managing executive feedback, defining attendee lists, and grounding discussions in customer context.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Harry holds 18.5% of the talking time here. How this is scored →

Harry as informed peer 1.2 Guest teaching 3.8 Guest disagreement 0.7 Harry pushing back 0.0
05100:0010:0020:0030:001:37–10:22 · Harry as informed peer 1/10 Scott Belsky on Prototypes, Customer Context, and Prioritization Harry asks standard exploratory questions while Scott Belsky delivers detailed frameworks on prototypes, room dynamics, and prioritizing first-mile user friction over feature requests. The dynamic is purely interview-based with Belsky educating the audience and host.10:22–13:35 · Harry as informed peer 1/10 Tony Fadell on Primary Paths and Beginner Mindsets Harry takes a very admiring tone, explicitly asking how Fadell manages to retain perspective from the high-level customer view. Fadell explains his technique of keeping a beginner mindset and constantly asking basic questions.13:35–20:33 · Harry as informed peer 2/10 Aparna Chennapragada on Review Stages and Executive Communication Harry asks well-crafted questions around review agendas and feedback management. Aparna provides strong executive guidance on stage-appropriate reviews and avoiding the trap where a leader's whisper is misconstrued as a scream.20:33–23:12 · Harry as informed peer 1/10 Lenny Rachitsky on Problem Framing and Feedback Clarification Lenny Rachitsky explains the two primary failure modes of product reviews: losing connection to the core problem and failing to clarify the desired feedback level. Harry offers brief transitions and open questions.23:12–33:21 · Harry as informed peer 2/10 Kayvon Beykpour on Twitter's Review Cadence and Leadership Debriefs Kayvon Beykpour breaks down Twitter's product review cadence, leadership debriefs, and distinguishing between feedback and directives. Harry prompts Kayvon on communication nuances and prioritization amidst overwhelming noise.33:21–33:45 · Harry as informed peer 0/10 Masterclass Conclusion and Listener Feedback Harry wraps up the compilation masterclass episode in a brief solo monologue and transitions to sponsor closing copy.1:37–10:22 · Guest teaching 5/10 Scott Belsky on Prototypes, Customer Context, and Prioritization Harry asks standard exploratory questions while Scott Belsky delivers detailed frameworks on prototypes, room dynamics, and prioritizing first-mile user friction over feature requests. The dynamic is purely interview-based with Belsky educating the audience and host.10:22–13:35 · Guest teaching 4/10 Tony Fadell on Primary Paths and Beginner Mindsets Harry takes a very admiring tone, explicitly asking how Fadell manages to retain perspective from the high-level customer view. Fadell explains his technique of keeping a beginner mindset and constantly asking basic questions.13:35–20:33 · Guest teaching 5/10 Aparna Chennapragada on Review Stages and Executive Communication Harry asks well-crafted questions around review agendas and feedback management. Aparna provides strong executive guidance on stage-appropriate reviews and avoiding the trap where a leader's whisper is misconstrued as a scream.20:33–23:12 · Guest teaching 4/10 Lenny Rachitsky on Problem Framing and Feedback Clarification Lenny Rachitsky explains the two primary failure modes of product reviews: losing connection to the core problem and failing to clarify the desired feedback level. Harry offers brief transitions and open questions.23:12–33:21 · Guest teaching 5/10 Kayvon Beykpour on Twitter's Review Cadence and Leadership Debriefs Kayvon Beykpour breaks down Twitter's product review cadence, leadership debriefs, and distinguishing between feedback and directives. Harry prompts Kayvon on communication nuances and prioritization amidst overwhelming noise.33:21–33:45 · Guest teaching 0/10 Masterclass Conclusion and Listener Feedback Harry wraps up the compilation masterclass episode in a brief solo monologue and transitions to sponsor closing copy.1:37–10:22 · Guest disagreement 1/10 Scott Belsky on Prototypes, Customer Context, and Prioritization Harry asks standard exploratory questions while Scott Belsky delivers detailed frameworks on prototypes, room dynamics, and prioritizing first-mile user friction over feature requests. The dynamic is purely interview-based with Belsky educating the audience and host.10:22–13:35 · Guest disagreement 1/10 Tony Fadell on Primary Paths and Beginner Mindsets Harry takes a very admiring tone, explicitly asking how Fadell manages to retain perspective from the high-level customer view. Fadell explains his technique of keeping a beginner mindset and constantly asking basic questions.13:35–20:33 · Guest disagreement 1/10 Aparna Chennapragada on Review Stages and Executive Communication Harry asks well-crafted questions around review agendas and feedback management. Aparna provides strong executive guidance on stage-appropriate reviews and avoiding the trap where a leader's whisper is misconstrued as a scream.20:33–23:12 · Guest disagreement 0/10 Lenny Rachitsky on Problem Framing and Feedback Clarification Lenny Rachitsky explains the two primary failure modes of product reviews: losing connection to the core problem and failing to clarify the desired feedback level. Harry offers brief transitions and open questions.23:12–33:21 · Guest disagreement 1/10 Kayvon Beykpour on Twitter's Review Cadence and Leadership Debriefs Kayvon Beykpour breaks down Twitter's product review cadence, leadership debriefs, and distinguishing between feedback and directives. Harry prompts Kayvon on communication nuances and prioritization amidst overwhelming noise.33:21–33:45 · Guest disagreement 0/10 Masterclass Conclusion and Listener Feedback Harry wraps up the compilation masterclass episode in a brief solo monologue and transitions to sponsor closing copy.1:37–10:22 · Harry pushing back 0/10 Scott Belsky on Prototypes, Customer Context, and Prioritization Harry asks standard exploratory questions while Scott Belsky delivers detailed frameworks on prototypes, room dynamics, and prioritizing first-mile user friction over feature requests. The dynamic is purely interview-based with Belsky educating the audience and host.10:22–13:35 · Harry pushing back 0/10 Tony Fadell on Primary Paths and Beginner Mindsets Harry takes a very admiring tone, explicitly asking how Fadell manages to retain perspective from the high-level customer view. Fadell explains his technique of keeping a beginner mindset and constantly asking basic questions.13:35–20:33 · Harry pushing back 0/10 Aparna Chennapragada on Review Stages and Executive Communication Harry asks well-crafted questions around review agendas and feedback management. Aparna provides strong executive guidance on stage-appropriate reviews and avoiding the trap where a leader's whisper is misconstrued as a scream.20:33–23:12 · Harry pushing back 0/10 Lenny Rachitsky on Problem Framing and Feedback Clarification Lenny Rachitsky explains the two primary failure modes of product reviews: losing connection to the core problem and failing to clarify the desired feedback level. Harry offers brief transitions and open questions.23:12–33:21 · Harry pushing back 0/10 Kayvon Beykpour on Twitter's Review Cadence and Leadership Debriefs Kayvon Beykpour breaks down Twitter's product review cadence, leadership debriefs, and distinguishing between feedback and directives. Harry prompts Kayvon on communication nuances and prioritization amidst overwhelming noise.33:21–33:45 · Harry pushing back 0/10 Masterclass Conclusion and Listener Feedback Harry wraps up the compilation masterclass episode in a brief solo monologue and transitions to sponsor closing copy.

speaking balance: gold is Harry, purple is the guest (3 minute bins)

0:00 · Harry 58.1% · guest 41.9%0:00 · Harry 58.1% · guest 41.9%3:00 · Harry 9.3% · guest 90.7%3:00 · Harry 9.3% · guest 90.7%6:00 · Harry 7.3% · guest 92.7%6:00 · Harry 7.3% · guest 92.7%9:00 · Harry 8.2% · guest 91.8%9:00 · Harry 8.2% · guest 91.8%12:00 · Harry 24.7% · guest 75.3%12:00 · Harry 24.7% · guest 75.3%15:00 · Harry 20.2% · guest 79.8%15:00 · Harry 20.2% · guest 79.8%18:00 · Harry 15.4% · guest 84.6%18:00 · Harry 15.4% · guest 84.6%21:00 · Harry 10.8% · guest 89.2%21:00 · Harry 10.8% · guest 89.2%24:00 · Harry 2.5% · guest 97.5%24:00 · Harry 2.5% · guest 97.5%27:00 · Harry 9.7% · guest 90.3%27:00 · Harry 9.7% · guest 90.3%30:00 · Harry 1.8% · guest 98.2%30:00 · Harry 1.8% · guest 98.2%33:00 · Harry 81.7% · guest 18.3%33:00 · Harry 81.7% · guest 18.3%
Sharpest disagreement ▶ 26:03 Kayvon pushing teams on conviction

In a highly collaborative episode, Kayvon describes actively challenging presenting product teams to test whether they hold genuine conviction rather than just telling executive leadership what they want to hear.

 Hardest push from Harry ▶ 12:12 Harry questioning execution vs high-level vision

Harry pushes Tony Fadell to explain how leaders practically avoid getting trapped in minutiae and step back to evaluate eliminating steps entirely.

 Biggest teaching moment ▶ 16:45 Aparna on how executive feedback is received

Aparna educates on executive communication dynamics, explaining that a senior leader's whisper is heard as a scream and sharing her concrete 'terms of service' disclaimer strategy.

 Harry holds his own ▶ 16:33 Harry framing executive communication challenges

Harry articulates a key product leadership dilemma regarding how leaders can deliver constructive feedback without it being interpreted as an immutable command.
the scores for every segment, with the reasoning behind each
ChapterTopicHarry as informed peerGuest teachingGuest disagreementHarry pushing backWhy
Scott Belsky on Prototypes, Customer Context, and Prioritization 1510 Harry asks standard exploratory questions while Scott Belsky delivers detailed frameworks on prototypes, room dynamics, and prioritizing first-mile user friction over feature requests. The dynamic is purely interview-based with Belsky educating the audience and host.
Tony Fadell on Primary Paths and Beginner Mindsets 1410 Harry takes a very admiring tone, explicitly asking how Fadell manages to retain perspective from the high-level customer view. Fadell explains his technique of keeping a beginner mindset and constantly asking basic questions.
Aparna Chennapragada on Review Stages and Executive Communication 2510 Harry asks well-crafted questions around review agendas and feedback management. Aparna provides strong executive guidance on stage-appropriate reviews and avoiding the trap where a leader's whisper is misconstrued as a scream.
Lenny Rachitsky on Problem Framing and Feedback Clarification 1400 Lenny Rachitsky explains the two primary failure modes of product reviews: losing connection to the core problem and failing to clarify the desired feedback level. Harry offers brief transitions and open questions.
Kayvon Beykpour on Twitter's Review Cadence and Leadership Debriefs 2510 Kayvon Beykpour breaks down Twitter's product review cadence, leadership debriefs, and distinguishing between feedback and directives. Harry prompts Kayvon on communication nuances and prioritization amidst overwhelming noise.
Masterclass Conclusion and Listener Feedback 0000 Harry wraps up the compilation masterclass episode in a brief solo monologue and transitions to sponsor closing copy.

Statements from this episode (13)

Insight
Belsky: A working prototype is worth a hundred meetings
“I deeply, deeply believe in the fact that a prototype is worth a hundred meetings, and if you can have a discussion around a PowerPoint with bullet points and stuff, I mean, you're gonna miss so much”
Scott Belsky Jul 6, 2022 ▶ 1:50
Insight
Belsky: Exclude engineers from initial product reviews to protect ideation
“I believe that some of the initial product reviews should only be with the product and design team, because engineers are really there to discuss the cost of something.”
Scott Belsky Jul 6, 2022 ▶ 3:59
Insight
Belsky: Intuition identifies the mountain, but data helps you climb it
“Intuition is what brings you to a mountain to climb. Data is what helps you climb it.”
Scott Belsky Jul 6, 2022 ▶ 8:38
Assertion Not checkable as stated
Belsky: Focus groups universally rejected the Behance concept in 2006
“We had a focus group back in 2006, and we got a group of creatives together that we wanted to build a portfolio network for. You know, we asked folks, do you need, you know, we described what we were building, and universally everyone said, no, I don't need th…”
Scott Belsky Jul 6, 2022 ▶ 8:58
Insight
Fadell: Products must optimize around a single primary customer path
“And sometimes we'll like go, it's a third. I'm like, well, then we're going to try to please everyone and please no one. So pick one. There's always got to be a one priority path. If not, you probably not structured your product right. So you pick that primary…”
Tony Fadell Jul 6, 2022 ▶ 11:07
Insight
Fadell: Adding one step upfront can eliminate ten steps downstream
“Too many people stay so inward about this step, that step, this step, that step. They don't step back and they go, well, what's a different way of doing it? Where can we remove steps? Where do we actually add one step, but we can remove 10 steps down the line?…”
Tony Fadell Jul 6, 2022 ▶ 11:32
Insight
Chennapragada: Early-stage product reviews require small, cross-hierarchy groups
“When the product review is for an early, fragile idea, still in the solve stage, seeking product market fit, you want a small group, and you want the problem solvers in the group, regardless of the organizational hierarchy, and you need a divergent mindset.”
Aparna Chennapragada Jul 6, 2022 ▶ 14:27
Assertion Partly supported
Chennapragada: Robinhood is the only financial company with an Apple Design Award
“That's such a pleasant and positive surprise for me at Robinhood, which is designers and researchers. They're there from the beginning, but it's only financial company that won the Apple Design Award.”
Aparna Chennapragada Jul 6, 2022 ▶ 16:20
Insight
Chennapragada: A senior leader's whisper is heard as a scream
“When you're a senior leader, your whisper is heard as a scream, right? You just say, hey, you guys should think about it. And the next thing you know, they've spun up like gigantic effort”
Aparna Chennapragada Jul 6, 2022 ▶ 16:46
Insight
Chennapragada: Executives fail if they constantly intervene in team prioritization
“If you can't trust that person to kind of make that call, and you're making that call constantly, you're failing.”
Aparna Chennapragada Jul 6, 2022 ▶ 18:48
Insight
Rachitsky: Unframed product reviews are the primary source of wasted time
“I think the most common problem in these meetings that causes all kinds of wasted time is not connecting back to the problem that you're solving as a team. The problem that feature is trying to solve.”
Lenny Rachitsky Jul 6, 2022 ▶ 20:53
Insight
Beykpour: Product reviews serve two customers: product teams and leadership
“I think there's like two customers for a product review. There's the team that's a customer, and then there's like the leadership team that's a customer.”
Kayvon Beykpour Jul 6, 2022 ▶ 24:26
Disclosure
Beykpour: Twitter leadership distills product reviews into 4-5 written bullets
“After we have the live product review, we have a debrief as a leadership team, a fifteen-minute debrief, where we try and, amongst ourselves, say, alright, we just talked about a lot of stuff. What's the most useful feedback we can, like, clarify and write dow…”
Kayvon Beykpour Jul 6, 2022 ▶ 32:30
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more