StarZero All shows Try the podcast clipper →

A-B test

also referred to as: a-b tests · ab test

5 statements across 5 episodes · 2 bullish · 2 bearish · 5 people on the record · first statement Nov 9, 2023 by Ramesh Johari · across every show →

Everything said about A-B test, oldest first

Nov 9, 2023 negative
Insight
Johari: Rewarding only winning experiments treats failed tests as wasted time
“If I reward you for shipping winners, then what I'm really telling you is all the time that you spent testing out failures was wasted time.”
Ramesh Johari Nov 9, 2023 ▶ 1:00:38 Marketplace lessons from Uber, Airbnb, Bumble, and more | Ramesh Johari (Stanford professor)
Feb 18, 2024 positive
Insight
Lemkin: Startups must always hire their first two sales reps together
“So you need to hire One rep and you've got to hire two because otherwise there's no AB test. You have to AB test humans. You have to AB test humans. You've got to hire two as hard as it is.”
Jason Lemkin Feb 18, 2024 ▶ 14:55 Building a world-class sales org | Jason Lemkin (SaaStr)
Feb 27, 2025 positive
Assertion Not checkable as stated
Baxter: Notes drop likes and reposts by 30% to 40% in internal A/B tests
“We saw more like 30 to 40% engagement rate drops for likes and reposts and an AB test we ran. When comparing showing a post with or without a note”
Jay Baxter Feb 27, 2025 ▶ 27:18 An inside look at X’s Community Notes | Keith Coleman & Jay Baxter
Sep 21, 2025
Insight
Zhuo: You cannot A/B test your way into a great product
“You just actually can't make a really great product by thinking you can AB test your way into it.”
Julie Zhuo Sep 21, 2025 ▶ 36:02 From managing people to managing AI: The leadership skills everyone needs now | Julie Zhuo
Aug 2, 2026 negative
Insight
Multi-year roadmaps waste tech's core advantage of iterative learning
“I think there's a second failure mode, which is people sit down and write up these long roadmaps and strategic vision docs of what we'll do over the next two or three years that kind of loses the comparative advantage we have over every other industry, which i…”
Tom Verrilli Aug 2, 2026 ▶ 1:02:17 This CPO regrets that product management exists | Tom Verrilli (CPO of Whatnot)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more