Insight
Duolingo's true core superpower is habit formation, not language teaching
“Duolingo, even though the product they're providing is around language learning, I think the original ethos of how to start the company was really around motivation, right? The hardest thing to its habits, right? How do you build that daily habit? And I actual…”
Insight
Deep domain experience can be a crutch when hiring in AI
“Over and over and over, like I saw some of the highest performers just being people that had very high agency, had that clock speed, had that energy. Yes, they cared about the mission, but they didn't necessarily need to have deep experience on that matter. An…”
Insight
Cheng: Existing user retention is the primary compounding lever for mature daily apps
“I think, especially if you have a product that has daily frequency, like that's the, actually the retention that matters the most is that like of your existing user base that has developed a habitual pattern, how sticky is your product? And it's that retention…”
Assertion Not checkable as stated
Cheng: Duolingo's product experience changes multiple times daily per user
“The product experience of Duolingo actually like changes multiple times per day for each user, which is pretty shocking.”
Assertion Not checkable as stated
Duolingo tracked user screenshots to identify and enhance organic viral moments
“We invested actually in some time to essentially add screenshot tracking for, like, a brief period of time in the app, just so we could find out the hotspots of where users were doing screenshots, and you see this in other apps, too. It's not necessarily, like…”
Insight
Albert Cheng: Music and growth both rely on rapid mistakes and repetition
“I think music and growth, they both rely on this just consistent repetition. Like you're constantly making mistakes. You have this super tight feedback loop. You have to get really resilient to just making mistakes all the time. And you know that the way of le…”
Insight
Albert Cheng: Growth requires pairing rigid structural models with daily creativity
“They both have this like structural underpinning to them with growth. You have a growth model. You have metrics, you have experiments, you have channels, things like that, but you also need on a day-to-day basis to have creativity. You gotta come up with, like…”
Assertion Not checkable as stated
80% of Chess.com users who review games do so after winning
“80% of people that review their games actually do so after a win.”
Assertion Not checkable as stated
A positive post-loss review flow increased Chess.com subscriptions by 20%
“That change alone was pretty dramatic for us. It grew game reviews by 25%, subscriptions by 20%, user retention by a lot as well.”
Insight
Cheng: Typical experiment win rate is 30% to 50%
“I mean, in my experience, the typical Win rate, and I hate to use that term for experiments, is, is often something like 30 to 50%.”
Insight
Insignificant experiment results signal a growth team is over-exploiting an area
“And if I'm starting to see like more and more experiments that are not statistically significant, That may be a signal to me to say, okay, we might have ex kind of tried to exploit a little bit too far. Like there might not be as much juice to squeeze.”
Assertion Not checkable as stated
Grammarly nearly doubled upgrade rates by sampling paid features for free users
“All of a sudden people were seeing Gramly as a much more powerful tool than they were before, and our upgrade rates like nearly doubled just through this change.”
Insight
Consumer freemium works best when core features are permanently free
“So I think these things are usually why I lean toward make sure that the core value proposition that you're providing users is free and is sort of permanently free. And then you layer on kind of a sampling or a taste of some of the premium features that are on…”
Insight
Reverse trials excel in B2B but struggle in consumer products
“I think if you have, especially a B to B feature where you may have some lock in reverse trials can be super powerful. You just want to get people in there. You don't need to ask for their credit card because they're using your CRM or they're investing quite a…”
Insight
Cheng: 30% to 40% Day 1 retention is solid for consumer apps
“I think when you have your D one retention,
Somewhere around, like, the 30 or 40% mark, like, that's quite solid, I think, for a consumer app.”
Insight
Background utilities rely on activation aha moments far more than daily retention
“One exception is that Grammarly was a different type of product and that you install it and you don't proactively open it every day. So that was kind of interesting to me because I assumed that you should always just focus on existing user retention, but for a…”
Assertion Not checkable as stated
Duolingo strictly caps internal product reviews at 10 to 15 minutes
“They have templates for everything and like their product reviews are like 10 or 15 minutes. It's just people go in and out. So it's just, it's kind of a surreal environment about how rapidly and consistently they work.”
Assertion Not checkable as stated
Cheng: Social marketing drove 20% to 30% of daily new users at Duolingo
“And then we would track back in the product experience. Like, how did you hear about us? And put all those channels in there. And some days it would be like, holy shit, like it's bringing in 20, 30% of like our new users in any given day.”
Insight
Cheng: Growth experimentation must pair with capitalizing on viral cultural waves
“And it's like the growth experimentation is more the slow and steady or fast and steady, I should say approach where you're just continually iterating. You're making the product experience better, but then every so often, right, there's a big wave that comes i…”
Assertion Not checkable as stated
Cheng: LLMs are poor at playing chess and hallucinate moves
“You know, interestingly, LLMs themselves are quite bad at playing chess. Like they hallucinate moves. They look at patterns, right? They're very good at pattern recognition, but not so good at going super, super, super deep on a specific chess thing.”
Assertion Not checkable as stated
Cheng: AI has not enabled PMs to ship production code yet
“We have not yet gotten to the point where like product managers themselves are actually shipping the code into production, but it's dramatically shortened the amount of time it takes to conceive of, especially like a bolder idea that you might have.”
Insight
Cheng: Startups should not build custom experimentation platforms from day one
“But no, I typically don't
Encourage companies to build experimentation in-house from day one.”
Assertion Not checkable as stated
Chess.com scaled from zero to 250 annual experiments in under two years
“So prior to 20, 23, the company practically didn't experiment at all.
Last year they did about 50.
This year they're
On pace for about 250.
And then next year we have that ambitious target of a thousand.”
Insight
The true purpose of goals is mapping prerequisite operational truths
“The whole point of setting a goal is that you can have conversations about what would need to be true to actually hit that goal.”