Jul 11, 2024 · 2h 34m · lennys-podcast
Building product at Stripe: craft, metrics, and customer obsession | Jeff Weinstein (Product lead)
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
Stripe product lead Jeff Weinstein shares his comprehensive product management philosophy, detailing how direct customer engagement, rigorous metric selection, internal study groups, and balancing rapid urgency with long-term compounding drive world-class software development.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Lenny holds 16.1% of the talking time here. How this is scored →
Lenny as informed peer 4.0 Guest teaching 5.8 Guest disagreement 1.1 Lenny pushing back 1.3
speaking balance: gold is Lenny, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 37:40 Discounting friend feedback entirely
Jeff forcefully rejects the common practice of relying on friendly user feedback, declaring that non-paying friend input must be discounted to absolute zero.
Hardest push from Lenny ▶ 54:47 Pushback on perverse metric incentivesLenny directly challenges Jeff's 'zero support ticket' metric by offering Airbnb counterexamples where teams made support harder to reach to game the number.
Biggest teaching moment ▶ 51:15 Zero support tickets metric explanationJeff educates Lenny on how measuring the binary percentage of customers who complete onboarding with zero support tickets aligned product fixes with organic growth.
Lenny holds their own ▶ 2:24:55 Demonstrating deep knowledge of 7 PowersLenny cites specific nuances from his interview with Hamilton Helmer regarding why Process Power is rarely a defensible moat compared to Counter-Positioning.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Lenny as informed peer | Guest teaching | Guest disagreement | Lenny pushing back | Why |
|---|---|---|---|---|---|---|
| Episode Preview and Key Themes | 0 | 0 | 0 | 0 | Monologue introductory preview and host overview of Jeff Weinstein's background at Stripe. Host-side scores are zeroed out for the monologue format. | |
| Sponsor Message: Pendo | 0 | 0 | 0 | 0 | Sponsor message and ad read for Pendo and Cycle. Scores are kept at zero for standard advertising material. | |
| Scaling Global Payment Methods at Stripe | 4 | 6 | 1 | 1 | Jeff explains the shift from short-term intensity to long-term compounding infrastructure when scaling global payment methods. Lenny asks targeted questions exploring the concept. | |
| The Power of Silence in Customer Discovery | 5 | 7 | 2 | 1 | Jeff cautions against jumping straight to pitching or superficial craft, advocating for sitting in silence to discover true burning customer problems. Lenny actively listens and synthesizes the insights. | |
| Responding Quickly and Turning Detractors into Promoters | 4 | 6 | 1 | 1 | Jeff details the necessity of lightning-fast response times to turn detractors into enthusiastic promoters. Lenny probes deeper into his personal communication habits. | |
| Managing Feedback Volume and Structured Discovery Programs | 5 | 7 | 2 | 2 | Jeff argues that feedback from friendly users is misleading noise and should be discounted entirely in favor of paying customers. Lenny challenges him on how to manage high volumes of incoming input. | |
| Securing Financial Commitment from Enterprise Prospects | 5 | 7 | 2 | 2 | Jeff emphasizes demanding actual upfront financial commitments from enterprise prospects before altering product roadmaps. Lenny reinforces the distinction between theoretical willingness to pay and actual payment. | |
| Improving Stripe Atlas via the Zero Support Ticket Metric | 4 | 8 | 1 | 1 | Jeff explains how optimizing Stripe Atlas around the 'zero support tickets' cohort metric transformed product quality and market share. Lenny prompts him on selecting actionable team-level metrics. | |
| Avoiding Perverse Incentives and Cohort Optimization | 6 | 7 | 1 | 3 | Lenny brings up Airbnb counterexamples where reducing support volume led to perverse incentives, pushing Jeff to explain counter-measures. Jeff clarifies how cohort analysis and specific tactical KRs prevent gaming. | |
| Live Demonstration of Silence and Uncovering Bad Days | 4 | 6 | 2 | 1 | Jeff turns the tables on Lenny with a live demonstration of conversational silence to uncover what causes a 'bad day'. Lenny plays along and shares his own Stripe dashboard pain points. | |
| Sponsor Message: Anvil | 0 | 0 | 0 | 0 | Sponsor message for Anvil Document SDK. Scores remain baseline for an advertising interruption. | |
| Scaling Study Groups and Overcoming Product Entropy | 4 | 8 | 1 | 1 | Jeff introduces Stripe's 'Study Groups' practice where cross-functional employees roleplay external customers without internal knowledge to fight product entropy. Lenny seeks tactical details on team mechanics. | |
| Connecting User Experience and Craft to Business Revenue | 5 | 7 | 2 | 2 | Lenny questions the direct link between craft polish and business growth. Jeff reframes the entire offline service flow, support channels, and paper mailings as part of core product craft. | |
| Managing Study Group Outputs and Craft Bug SLAs | 4 | 6 | 1 | 1 | Jeff details how Study Group findings feed into existing bug rubrics and craft SLAs rather than creating bureaucratic overhead. Lenny probes into potential engineer friction. | |
| Balancing Team Autonomy with Customer Proximity | 5 | 6 | 1 | 2 | Lenny compares top-down quality mandates with bottom-up team autonomy. Jeff explains the balance of trusting teams while instilling customer proximity mechanisms. | |
| Automating 83(b) Elections and 1-Click Incorporation | 4 | 7 | 1 | 1 | Jeff unveils Stripe Atlas's new one-click automated company incorporation and 83(b) tax filing automation. Lenny inquires about the customer experience improvements. | |
| Atlas Business Impact, Cohort Velocity, and Solo Founders | 4 | 6 | 1 | 1 | Jeff outlines the macro impact of reducing startup setup friction, showing accelerated time to first revenue and growth in solo founders. Lenny highlights the macroeconomic implications. | |
| Running Atlas with a High-Leverage Ten-Person Team | 4 | 7 | 1 | 1 | Jeff reveals how a lean 10-person team operates Atlas by automating ruthlessly and leveraging third-party vendors with rigid SLAs. Lenny asks about back-office operations. | |
| Turning Company Administration into Software | 4 | 6 | 1 | 1 | Jeff discusses transforming corporate administration into software infrastructure. Lenny explores the boundaries of venture versus bootstrapped companies. | |
| Driving Zero-to-One Initiatives Inside Large Companies | 5 | 7 | 1 | 2 | Lenny cites peer feedback about Jeff cutting through PM framework dogma. Jeff explains that building quick proofs of existence and unconstrained stick-figure storyboards beats corporate debate. | |
| Ensuring Long-Term Economic Viability and Leadership Transition | 5 | 7 | 1 | 1 | Jeff shares how Atlas proved economic viability and navigated competitor dynamics with AngelList, ultimately leading AngelList to partner directly. Lenny praises the collaborative mindset. | |
| Co-Designing Products Directly with Customers | 5 | 7 | 2 | 2 | Jeff suggests giving customers literal write access to visual mockups so they design features themselves. Lenny notes that founder-customers give Atlas an unfair advantage, prompting Jeff to reframe. | |
| Lightning Round: Essential Book Recommendations | 6 | 5 | 1 | 2 | In the lightning round, Lenny and Jeff nerd out over Hamilton Helmer's 7 Powers framework, debating Counter-Positioning versus Process Power with informed peer perspectives. | |
| Lightning Round: Recommended Media and Documentaries | 4 | 7 | 1 | 1 | Jeff shares formative leadership lessons and direct feedback from Stripe co-founders Patrick and John Collison about focusing strictly on problems 1 and 2. Lenny wraps up the interview. |
Statements from this episode (57)
Weinstein: Aggressive deadlines inject contagious momentum into product teams
“We will do the work the night before it's due. So let's just make it due tomorrow. Can we turn tomorrow into today? So just optimistically seeing if we can just inject energy to go, go, go has produced surprising results. And I think it ignites in other people…”
Weinstein: Stripe will never regret investing in API latency and reliability
“We'll never regret spending time making the latency of our payments APIs at Stripe faster. We'll never regret making it more reliable to send AB three B election mails to the IRS. Like we will never regret those things. So let's just always compound those capa…”
Weinstein: Stripe's country and payment method additions were flat for 7–8 years
“And for the first. Seven or eight years of Stripe well prior to my being here, you know, the incremental country ads and the incremental new payment methods was relatively flat over time.”
Weinstein: Product craft is dessert after solving a burning problem
“And I think craft is kind of a. Dessert that you get after the meal of does your thing solve a real problem in the world? And are people clamoring, needing it badly?”
Weinstein: Customers only get out of bed for their top problem
“People don't really get out of bed for their second problem, right? They get out of bed for their first problem and you have to carefully listen and not pitch your customer or your prospective customer as you're trying to trying to figure this out.”
Weinstein: Silence in customer discovery replaces lengthy UXR surveys and build cycles
“Via silence, you can just create your roadmap pretty quickly and drop a lot of the long UXR, long survey, long build cycle approach.”
Weinstein: Direct access to 5 to 10 forward-looking customers gives sufficient signal
“You don't need 10,000 of those people to talk to. If you're text message friendly with five or 10 of those, you are going to have so much direct signal about where to go that you kind of forget how you did it in the past.”
Weinstein: Stripe Atlas had a bug granting 25 shares instead of 25%
“We had this bug in which for a handful of our legal docs, they were handing out, let's say, 25 shares rather than 25% of the shares. We dropped the percentage sign, and thankfully, a founder noticed this in the docs and tweeted about it.”
Weinstein: Small homework assignments filter high-signal users better than 30-minute calls
“Do you mind sending me an email with three to five bullet points about the details of how you got to this issue? And that's not a 30 minute meeting. Don't need to blow up your whole life to get on the phone with them. It's not a huge homework assignment to the…”
Weinstein: Stripe crowdsourced 65 bug videos from a single tweet
“We ran our first program, we got 65 videos, which we did we found dozens of issues, which we did It was an incredibly valuable use of our time, and it really came from just a single tweet.”
Weinstein: B2B builders should discount friend feedback to zero
“I just set a rule, which was we discount all of that feedback from our friends to zero. Like that is not of interest to us. It doesn't, we don't even write it down. It's not part, it's just not part of what we're talking about at all. We're only interested in …”
Weinstein: Charging money is the best forcing function to uncover real value
“And then the paying part is a forcing function because, again, even with Sarah, because you're paying attention to her and solving her problem a bit, she'll say, of course, oh, this is great. I want feature X, Y, and Z. Can it do one, two, and three? Naturally…”
Weinstein recommends improv training classes for customer discovery skills
“I encourage people to take an improv training class or two, just to get people out of their skin a bit.”
Weinstein: Demand upfront money before building custom enterprise features
“If we're super serious about this, send us a million dollars. Like wire us a million dollars. We'll happily wire it back anytime you need it, but let's actually Put some stake in the ground about the value. And I find that in the cases in which they're like, w…”
Weinstein: Stripe requires enterprise financial commitments before building custom roadmap items
“And even at Stripe scale, I've heard our founders somewhat push this methodology on us, where you, one from the outside might think, well, it's a 8000 person company. Surely they have just regular ways of building things for larger customers. And like, we too …”
Weinstein: Asking users about daily life reveals their biggest problems quickly
“Ask them about their regular life as a human. You know, what did you do yesterday? And they'll be like, oh, at work? I'm like, we're not. Whatever. And people just, they'll start to spill. They'll just start to spill and eventually they'll get to their biggest…”
Weinstein: Product metrics should measure customer value, not internal events
“Metrics at their best are A numerical representation of the value we're providing for the customer.”
Weinstein: Stripe Atlas grew zero-ticket completion from 15% to 85%
“And over about 18 months, we took that number from 15% to 85.”
Weinstein: Product dashboards should measure metrics customers would celebrate seeing
“And I think you have to find a measure by which it speaks directly to the, to what the customer wanted, and that if you by accidentally leaked your dashboard to them, your customer would be ecstatic to learn that that's what you were measuring the whole time.”
Weinstein: Nearly 100% of Stripe Atlas risk reviews complete within an hour
“And now basically a hundred ish percent of people get their risk review within an hour from, you know,
A long tail taking a long time.”
Weinstein: Teams should track friction via 'Users Having a Bad Day' logs
“And I think for almost any scale business, if you are bored one day and you're not sure what to measure, just make a user having a bad day chart, omit a log line and count it as a bar chart. And then anybody else can add their own bar chart on top of it. And s…”
Weinstein: Concise, emotional metric names drive team alignment and buy-in
“The brevity and the focus and the customer
Mindset built into the chart name can become currency inside the company. It's like, oh, I'm working on making the, like this chart go up and it feels good to just say the name out loud rather than some complicated un…”
Weinstein: Stripe dashboard usage predicts team alignment and customer obsession
“In fact, we can measure at Stripe the usage of our dashboards by team, and so we can see which teams are themselves looking at their own metrics, and that is an incredibly useful predictor of how on the same page they are and how customer obsessed they are.”
Jeff Weinstein: I will not look at metrics not on go/metrics
“My rule is if it's not on gometrics, I'm not going to look at it.”
Weinstein: Metrics are almost always wrongly defined for weeks
“Metrics are almost always wrong for many weeks. We didn't quite get the definition correctly. You have to live in the metric for quite a while before you really believe in it.”
Weinstein: Product entropy inevitably breaks smooth customer workflows as companies scale
“Anyone who's built a product that has. Gone over the horizon of it's actually in production and being used for some, you know, a year or more as you go to iterate on it, especially when you're in a larger company and there's multiple teams and multiple product…”
Weinstein: Effective customer empathy sessions require roleplay and zero live problem-solving
“And there are. Two rules to study group. Rule one is you do no longer work at Stripe. You, you're not, you do not work at Stripe. Not pretend you don't work at Stripe. Not try to forget. You do not work at Stripe. You've never worked at Stripe... And rule two …”
Weinstein: Stripe Ran Over 25 Study Groups with 250+ Participants in 2024
“And we have done more than 25 of these at Stripe thus far in the last, just this year, last few months of 24. More than 250 people have gone, like, participated in a study group”
Weinstein: Product craft includes sales, support, and compliance, driving business value
“So I feel when people think, oh, you know, product quality and craft has some limit towards business value. Like there's some asymptote that you have to be like, well, kind of product plate time quality is over. We need to talk about business. It's like, let's…”
Weinstein: Teammates struggling with products motivates fixes more than customer complaints
“Seeing your fellow teammates struggle to use your thing in some way is more motivating than the customer, because you can kind of always say to the customer, well, they didn't really know, or they have some special setup. You know, you probably shouldn't say t…”
Weinstein: Stripe requires teams to acknowledge P0 craft bugs within seven days
“We have a rubric of craft related tags for our bug system, and if it is a sort of a P zero bug, which is not an incident, right? It doesn't mean just put down your pencils. You do need to acknowledge it at Stripe within seven days.”
Stripe allows product teams to relabel and re-prioritize bug severity
“We have a rubric on some of the craft related bugs, but it, but again, we also allow our, we let the teams relabel them. And so maybe it's actually not a P zero from their eyes. And we like, that's the trust we put in the teams.”
Weinstein ranks the three best methods for adopting customer mindset
“Best is if it's you and you're your own customer. Okay. Second best would be sitting right next to the customer in the outside world. And then like, okay, fine. I'll take a third best, which is pantomiming the customer. And with a zero with enforcing, you don'…”
Weinstein: Reducing incorporation friction and cost directly increases startup creation
“We found over and over again that increasing the ease and simplicity and decreasing the cost and complexity tends to lead to just more of that thing. And we have a fundamental belief that there should be more startups and they're not finite.”
Weinstein: Instacart signed up for Stripe with a Gmail address
“Instacart signed up for Stripe with a Gmail address”
Weinstein: Stripe Atlas automates company creation into a single click
“When this podcast airs, I guess today it will be true that when you go to start a company on Atlas, it will just be a single click. You go to type in your friends' names, how, what the name of the company will be. It'll tell you if it's available automatically…”
Weinstein: Stripe Atlas maintains an 80+ NPS with a 50% response rate
“Atlas in the eighties with almost 50% response rate is quite high.”
Weinstein: Automated Stripe Atlas halves time for startups to charge first customer
“We're seeing like half the time it takes to get to your first customer, just like shave a whole week off of your company.”
Weinstein: Stripe Atlas sees an all-time high in solo founders
“We have seen since doing much of this automation work that more solo founders are using Atlas than ever before.”
Weinstein: 2024 Stripe Atlas startups hit $50M revenue twice as fast as 2023 cohort
“We have the sort of cohort of 20, 24 startups and Atlas got to fifty million dollars in revenue twice as quickly as the cohort in 20, 23.”
Weinstein: 55,000 Stripe Atlas companies generate $5B in annual revenue
“Companies that have started through Atlas has been 55,000 of them to date are doing five billion dollars a year in revenue.”
Weinstein: Atlas only takes on work it can fully automate
“And we just don't pick up work. We can't automate because we know that we need the leverage. And so we're not going to tackle We're not going to put ourselves in situations in which we have to compete to be the best. We're going to put ourselves in situations …”
Weinstein: Using third-party vendors forces teams to build more resilient software
“And two, I think it also causes us to build better software in that we now need to evaluate If something's actually working because it's happening externally, whereas when you build it yourself, again, you have this natural feeling, well, we built it. It must …”
Weinstein: Over 20% of Atlas multi-founder teams are cross-border
“More than 20% of multi multi-founder teams have at least one founder from another country.”
Weinstein: The Stripe Atlas team is majority women
“It's majority women and we have more, more diversity to hire, but we were just very intentional to make it a team that had diverse perspectives.”
Weinstein: Team diversity is an up-funnel recruiting pool problem
“It's not a down funnel problem. It is an up funnel problem and where you have to just make sure that for each role you're comfortable with the outlet, like with the distribution of people and backgrounds in your candidate pool and go from there.”
Weinstein: 20% of Atlas founders say they wouldn't have launched without Stripe Atlas
“We ran a survey a little bit ago. We need to rerun this where we just ask people what they have started their business about without Atlas and about 20% of people said they wouldn't have or wouldn't have had then.”
Weinstein: Stripe Atlas will cross 10,000 83(b) filings, 100% on time
“And again, by the time this podcast airs, we will have crossed 10,083 elections filed. And we will have done them all a 100% on time.”
Weinstein: Proof of existence beats theoretical proof or debate in product development
“I find proof of existence to be an incredibly powerful proof rather than proof by theory or proof by Debate. It's just like, look, we did it one time.”
Weinstein: Product quality and tweets mean nothing without proven economics
“You can't just have half the story of just the product quality and the tweets. You have to have the economics.”
Weinstein: Stripe Atlas competitors will struggle long term due to business model
“And we, I super encouraged there to be more Atlas alternatives. That'd be great for founders. But I think over the longterm, it'll be difficult to do so just because of the business model.”
Weinstein: Company incorporation inevitably becomes an efficiency and cost problem
“This company starting process is going to become a efficiency cost problem. And there's so much long tail complexity with dealing with multiple financial institutions, multiple government processes, all of this legal complexity that it will be, and it's diffic…”
Weinstein: AngelList offered Stripe Atlas their incorporation business upon exiting
“And he said, Hey, we're going to get out of incorporation. This is not going to be our focus going forward. Do you want the business? It was like a year and a half after, after they had really gone out or maybe two years after they gone out or something like t…”
Stripe Atlas follows up directly on any NPS score below 10/10
“We have all the NPS scores going to a channel and anytime it's not a 10 for 10, we follow up directly.”