A/B testing

“There's this narrative that a company should come in and beta test everything and AB test everything. Let me tell you something. It's a lot better. You are at millions of visits per month or fifty million per month versus when you only have five or 10 or 20 or…”

“We just, we rolled it out two days ago. We didn't maybe test. It was a huge, huge change.”

“I think it just slows you down, encourages incremental thinking.”

“So I think this high volume A-B testing growth is a little less focal. Optimizing for the users on a lower volume basis is incredibly important for a lot of the successful startups today.”

“Testing doesn't mean timidity. You can always use the fact that you're testing something and you can run an AB test to test something, 99% and have a one percent hold back. You don't have to test one percent in Australia, right? Testing gives you data. You can…”

“60% of A-B testing fail.”

“For B to B, if you want to get results, you need to try something that is completely different because then you will get results a lot faster than if you do it in any other way.”

“A-B testing increases your type to market. Because if you A-B test, you first need to do your A-B test, then you see which one wins, and then you launch.”

“As much as A-B testing and like high velocity optimizations feel like progress, and to some extent they will be, when you're at a business of that scale where we're talking like 30 to forty billion in gross transaction volume, the only thing that really moves …”