Torres: Product teams can safely make decisions from small data feedback loops
Teresa Torres · Build better products with continuous product discovery | Teresa Torres · Oct 6, 2022 · at 43:25
Product coach Teresa Torres defends qualitative user research against critics who question making product decisions based on small sample sizes.
0:00 / 0:12exact quote · 12.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We're in the business of changing behavior, not seeking new knowledge, and we have really good feedback loops. And so we can make decisions based on small experiments. Because we're going to continue to get bigger feedback loops and more reliable data over time.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Teresa Torres
Torres: Calling product managers 'CEOs of the product' stems from toxic culture
“And I see analogies of the product manager is the decider and they're the CEO of the product. I think this is coming from toxic business culture personally.”
Torres: Effective teams run 6 to 12 assumption tests weekly
“That team that's struggling to test a single idea is still stuck in project-based research world. They're running experiments that take weeks to get results. Whereas when I talk about assumption testing, I'm working with a team that's running half a dozen to a…”
Torres: 98% of people write opportunities as solutions
“I can tell you that an opportunity is an unmet need, pain point, or desire, and that's great. But I can tell you that 98% of people that write opportunities write them as solutions. So we tend to just really struggle with this distinction between the problem s…”
Torres: Individual contributors should adapt personal habits rather than forcing org change
“If you're an individual contributor and you're not at a 10 person company, I would say don't try to force the organizational change. Organizational change is such a hard and messy problem. I feel like what I would do in that situation is I would just change th…”
Torres: 98% of tech has never experienced an effective product trio
“Probably 98% of the industry has never worked on a well-functioning product trio, and this idea sounds crazy.”
Torres: Asking users what they would do produces unreliable discovery data
“And I think that's a really big mistake that teams make. Is they, both in their prototype tests and in their interviews, they focus on what people would do, on what people think, on why they think they do something, and it's all really unreliable. It's a garba…”