Jackson Shuttleworth, Group PM leading retention at Duolingo, explains why the company focuses experimentation on the first seven days of user streaks.
Insight
Adding an explicit opt-out button to streak goals increased user commitment
“We captured, you know, just what happens if we add an opt out button and adding an opt out button when you would think like as a PM, oh, I'm like, you know, now users might not engage with my feature. That's a bad thing, but it was a huge win to let them do th…”
Insight
Strategic friction via haptics and animations significantly boosts user retention
“Your phone, you know, like there being a really cool haptic pattern as you extend your streak all of this stuff wins and it's cool because I think it wins There's a few reasons. One is it just makes you feel good, right? You know, you get some cool moment in y…”
Assertion Not checkable as stated
Switching Duolingo streaks to one daily lesson drove massive DAU growth
“One of the most impactful experiments we ran was about, this was actually as I was joining, we had, or just after I joined, we had run this experiment was to move it from a XP based streak to just do one lesson a day and you'd extend your streak. And, you know…”
Insight
Pre-selecting streak goals for users significantly reduced Duolingo engagement
“We thought once we built you know, a goal picker screen where you could pick between different streak lengths, we were like, oh, well, let's like recommend that users do a hard, you know, a harder goal and thinking that, okay, well, a harder goal is going to b…”
Assertion Not checkable as stated
Duolingo CEO Luis von Ahn personally reviews every proposed product experiment
“All of our changes at Duolingo go through product review that, you know, are reviewed by Luis. Luis reviews every single change that, you know, we propose or every experiment that we run”
Assertion Supported
Current user retention rate is Duolingo's most effective DAU growth lever
“What we found is that if we wanted to drive DAUs and Duolingo Cares, you know, our growth Northstar is DAUs, the metric that is most effective, you know, where a percentage change in that metric is, is most effective at driving DAUs is current user retention r…”