experiments
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Aug 4, 2024 by Brian Tolkin · across every show →
Everything said about experiments, oldest first
Aug 4, 2024 positive
Dropping A/B test confidence to 80% is acceptable in low-volume environments
“You may be able to reduce your power and say, Hey, we're going to run at 80% confidence for all of our experiments instead of this traditional 95%, because that's a worthy trade-off. And if we're wrong one more time out of 10, that's okay.”