A-B test
also referred to as: a/b test
3 statements across 3 episodes · 2 bullish · 0 bearish · 3 people on the record · first statement Sep 12, 2018 by Suhail Doshi · across every show →
Everything said about A-B test, oldest first
Sep 12, 2018
Doshi: B2B startups struggle to run A/B tests compared to consumer apps
“If you're in consumer the benefit of being in consumer is that you generally have you usually will have like hundreds or thousands of users such that you could actually go do an A-B test, whereas in B to B it's a lot harder to achieve that.”
Jun 26, 2019 positive
Hockenmaier: Monetization experiments require long-term five percent holdout groups
“Price and anything related to monetization is really tough, because it's basically a system of incentives, and it will change people's behavior. And so you have to observe these things over very long periods of time to make sure you're getting the right answer…”
Jul 10, 2025 positive
Ng: Use A/B testing to hone gut instincts, not just pick variants
“I don't just use the result of A-B test to pick product A or product B. My team will often sit down and look carefully at the data to hone our instincts, to speed up, to improve the rate at which we're able to use the first tactic to make high quality decision…”