Brian Tolkin, Head of Product at Opendoor and former early Uber employee, discusses the early operational mechanics of Uber's marketplace pricing.
Insight
Dropping A/B test confidence to 80% is acceptable in low-volume environments
“You may be able to reduce your power and say, Hey, we're going to run at 80% confidence for all of our experiments instead of this traditional 95%, because that's a worthy trade-off. And if we're wrong one more time out of 10, that's okay.”
Insight
Tolkin: Ship on intuition instead of pursuing false statistical precision
“If you're not going to get significance, if there's no other techniques at your disposal, then sometimes you just gotta trust your intuition and ship it. And if that's where, if that's what you believe, then that's what you believe. And you shouldn't spend tim…”
Insight
Tolkin: Local operations teams iterate faster and gather better qualitative insights than PMs
“The reality is operations teams, local teams can iterate faster, can
scale talking to customers really much more efficiently have great qualitative insights.”
Insight
Tolkin: Keep Product Reviews Under 10 People but Distribute Docs Broadly
“Big subscribers of the best conversations happen when they're relatively small. So try and keep it under, under 10. Could be wide distribution of the document, right? The artifacts created are actually really powerful and they're powerful for the whole team to…”
Assertion Not checkable as stated
Tolkin: Early Uber ignored support efficiency to focus entirely on core matching
“If you think about the early Uber network from the simplest form, you've got A rider and a driver, and you need to connect them, price the transaction, and issue some receipts, probably, you know, and collect payment. So it's like, okay, do we do that really w…”
Insight
Tolkin: Starting in operations is a strong foundation for product leaders
“Starting on the operation side gave a really deep understanding of like how the business actually works, right? You are truly operating it day in and day out. And the success of the city is, you know, in large part driven by The inputs that you are putting int…”