May 2, 2024 · 1h 21m · lennys-podcast
This will make you a better decision maker | Annie Duke (Thinking In Bets, former pro poker player)
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
Decision strategist and author Annie Duke shares evidence-based frameworks to enhance executive judgment, optimize team meetings, and shorten feedback loops. Through structured rubrics, predefined kill criteria, and nominal group techniques, Duke demonstrates how leaders can systematically eliminate cognitive biases and improve organizational decision quality.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Lenny holds 14.9% of the talking time here. How this is scored →
Lenny as informed peer 2.1 Guest teaching 5.8 Guest disagreement 3.0 Lenny pushing back 0.5
speaking balance: gold is Lenny, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 30:50 Annie rejects corporate alignment as dumb and coercive
Annie forcefully attacks a standard management norm, calling corporate alignment 'stupid' and arguing that demanding consensus forces meetings into coercive theater.
Hardest push from Lenny ▶ 35:25 Lenny questions team disenfranchisement in single-DRI modelsLenny presses Annie on the risk that having a single decision maker leaves team members feeling unheard and excluded from the final outcome.
Biggest teaching moment ▶ 47:20 Annie dismantles the venture excuse of 10-year feedback loopsAnnie mocks the notion that investors sleep like Rip Van Winkle for a decade, proving that intervening milestone predictions create rapid, verifiable feedback loops.
Lenny holds their own ▶ 42:40 Lenny synthesizes the discover-discuss-decide framework into product practicesLenny demonstrates domain mastery by sharply condensing Annie's extended organizational theories into a crisp, actionable operational summary for product teams.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Lenny as informed peer | Guest teaching | Guest disagreement | Lenny pushing back | Why |
|---|---|---|---|---|---|---|
| Episode Preview: Highlighting Decision Quality and Frameworks | 0 | 0 | 1 | 0 | Lenny delivers a solo intro previewing the episode themes and highlighting Annie Duke's background in poker, venture capital, and decision science. No interactive power dynamics occur during this introductory setup. | |
| Sponsor Message: Compliance Automation with Vanta | 2 | 5 | 2 | 0 | Following sponsor reads, Lenny asks Annie about the late Daniel Kahneman's legacy. Annie shares detailed personal insights into Kahneman's intellectual humility, adversarial collaborations, and willingness to discard non-replicating findings. | |
| Applying Decision Science to Parenting and Leadership | 2 | 6 | 2 | 0 | Lenny asks how decision science applies to parenting. Annie reframes parenting perfectionism by distinguishing resulting from control, introducing mental time travel and the 'nevertheless' boundary-setting technique. | |
| Improving Decision Accuracy: Making Implicit Models Explicit | 3 | 6 | 3 | 2 | Lenny cites Daniel Kahneman's remark that knowing cognitive biases doesn't stop personal bias to ask what delta decision training actually yields. Annie explains that real improvement requires replacing implicit models with structured external rubrics. | |
| Reconstructing Meetings: Discover, Discuss, and Decide | 2 | 7 | 5 | 0 | Annie strongly dismantles traditional meetings, asserting that only discussion belongs in meetings while discovery and decision should occur asynchronously. She forcefully attacks the term 'alignment' as coercive and unrealistic. | |
| Sponsor Message: High-Impact B2B Targeting on LinkedIn Ads | 3 | 6 | 2 | 2 | Lenny challenges how a single decision-maker model avoids alienating team members. Annie details nominal group techniques and non-judgmental active reflection to illustrate how true inclusion functions without forced consensus. | |
| Shortening Feedback Loops in Long-Horizon Decisions | 2 | 8 | 6 | 1 | Lenny asks about decision-making under long-horizon feedback loops in venture capital. Annie firmly rejects the premise, asserting that long feedback loops are a self-serving choice and that proxy milestones like Series A funding drastically compress evaluation cycles. | |
| Auditing Partner Intuitions and Rubrics at First Round | 2 | 7 | 3 | 0 | Lenny asks for concrete changes implemented at First Round Capital. Annie explains how scoring partner intuitions across independent dimensions uncovered where confident expert intuitions were either predictive or completely uncorrelated with success. | |
| Maximizing Premortems with Pre-Commitments and Kill Criteria | 3 | 6 | 3 | 0 | Lenny brings up premortems in product management. Annie sharpens the framework, emphasizing that premortems fail unless tied to concrete, binding kill criteria and explicit pre-commitments. | |
| The Science of Quitting: Sunk Costs and the Origins of Slack | 2 | 7 | 3 | 0 | Lenny asks about the science of quitting. Annie explains the psychological traps of sunk costs and identity preservation, using Stuart Butterfield's decision to shut down Glitch to create Slack as the definitive case study on the upside of quitting early. |
Statements from this episode (15)
Duke: Kahneman admitted priming studies in Thinking, Fast and Slow failed replication
“The thing about Danny was what, when you talked about it, he was the first one to tell you, like, I wish priming wasn't in the book. Doesn't replicate.”
Duke: Adversarial collaborations resolve scientific disputes by partnering with opponents
“Find someone who really disagrees with you, and then write a paper with them. And try to figure out what, with them, what's the study that would resolve the issue?”
Duke: Parents have essentially zero influence on their children's personalities
“You have very little, you have no influence whatsoever, basically on what your child's personality is. What you can do as a parent is make sure they say please and thank you.”
Duke: Kahneman's structured hiring rubrics raised hit rates from 50% to 65%
“And then, you know, what he found was after you've gone through that process, if you then sort of use your intuition after having done that, not before, that then you actually can really drastically improve sort of your hit rate on hiring. And in that case, it…”
Duke: Outside observers typically understand our situations better than we do
“We tend to think that we have insight that other people don't have when actually the other people probably have more insight into our situation than we do.”
Duke: The best way to gather opinions is independently and asynchronously
“The best way to get somebody's opinion is independently of other people's opinions, independently, asynchronously.”
Duke: Live meetings should only be used for discussion, not decisions
“Here's the thing that I think is the easiest to change, is to realize the only thing that's ever supposed to happen in a meeting is the discussion part.”
Duke: Corporate alignment is a stupid myth and shouldn't be expected
“The word alignment is stupid and it shouldn't be used. And I know I'm saying that very harshly, but it's true. It's dumb, because it doesn't exist. Like, you have 10 people in a room, and they're all really different people with different opinions, and they're…”
Duke: Aiming for consensus turns workplace meetings into coercive exercises
“If the goal is alignment, if the goal is agreement, then the meeting becomes coercive.”
Duke: Senior leaders voicing estimates first silences dissenting team estimates
“Particularly if you're senior, if you say, I think this is gonna take three months to launch, and I was thinking four weeks, you're never gonna hear four weeks from me. Ever. But if we get those opinions independently, you will actually hear that I think it's …”
Duke: First Round uses structured forms for independent investment opinions
“We do this, like, for example, at first round, we do this for, we have a structured forum for evaluating a company in terms of whether you should invest in it. Because, you know, there are facts and then there are the way that you model those facts. And so it'…”
Duke: Investors can choose to shorten 10-year feedback loops with intermediate milestones
“There is no such thing as a long feedback loop. You can make a decision about how long the feedback loop is. That is your choice to live in a long feedback loop. And you can choose to shorten the feedback loop. And the way you choose to shorten the feedback lo…”
Duke: People avoid tight feedback loops because facing immediate errors hurts
“It's very, very difficult for human beings to deal with feeling wrong in the moment, even if it helps them in the long run. It's just hard. And the tighter the feedback loop, the more that you risk finding out you were wrong in the short run.”
Duke: Premortems alone generally fail to change people's plans or behavior
“What you find with pre-mortems, this is actually work. I actually did this work with Marie Schweitzer and Linnea Gombe, who are both at Penn. Then when you have people do pre-mortems it generally doesn't actually change their plan very much, or it changed thei…”