Weiss: Early products lack the scale for A/B testing and require intuition
Noah Desai Weiss · Lessons from Slack on decision making, product-led growth, and taking big swings | Noah Desai Weiss · Jul 13, 2023 · at 5:16
Noah Desai Weiss, CPO at Slack, explains the limitations of empirical experimentation when building early-stage products.
0:00 / 0:12exact quote · 12.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And definitely for most early products, you don't even have the scale to actually be able to say, we ran a test, we're gonna run the test for a year before you get statistical significance. You have to use intuition, judgment, strategy a lot more.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Noah Desai Weiss
Weiss: Data solves easy product problems, but big swings require intuition
“What we used to actually say early on was, you know, data can help solve easy problems, but doesn't actually solve the hard problems. And hard problems are ones where you can't actually just experiment your way, you know, down incremental paths. You actually h…”
Weiss: Product taste is not innate and can be 100% learned
“My honest kind of feeling is that almost everything can be taught. That teaching may be more informal. It may be more observational. You know, product design, product intuition, I think is really about seeing what great looks like and being part of the process…”
Weiss: Next-gen product-led SaaS companies will reach $10B within a decade
“And then I think kind of the next generation of companies like notion air table and so on, you know, these companies are all early on in their life cycle. I think give it another decade. And I think, you know, the companies that are a billion or two billion mi…”
Weiss: Product managers acting like "mini-CEOs" alienate their teams
“I will tell you that people who take the approach of being a mini CEO for a team are the ones who their teams wind up saying, why do we have to have a product manager on our team? Can't we do it without them? Because, you know, you can wind up accidentally bei…”
Weiss: PLG companies expanding to enterprise shouldn't start with outbound BDRs
“Starting off with building out a huge BDR team to do inside sales for cold leads feels like If you already had a product-led growth motion, not the right place to begin. Because I think, without a doubt, the best leads aren't ones that you cold emailed or that…”
Weiss: Product founder CEOs should follow a U-shaped involvement model
“If you think about like a major product initiative, not an experiment, but something more significant, that's like this big kind of bet. And you think about the X axis is kind of the time that goes on from the project starting to maybe launch. And the Y axis i…”