The Ledger, every show
Every statement that passed quotation and attribution checks, across all 44 shows. Pick shows below, then mix any filter with any other.
shows 
every show 44 of 44
Cheng: Duolingo's product experience changes multiple times daily per user
“The product experience of Duolingo actually like changes multiple times per day for each user, which is pretty shocking.”
Duolingo tracked user screenshots to identify and enhance organic viral moments
“We invested actually in some time to essentially add screenshot tracking for, like, a brief period of time in the app, just so we could find out the hotspots of where users were doing screenshots, and you see this in other apps, too. It's not necessarily, like…”
80% of Chess.com users who review games do so after winning
“80% of people that review their games actually do so after a win.”
A positive post-loss review flow increased Chess.com subscriptions by 20%
“That change alone was pretty dramatic for us. It grew game reviews by 25%, subscriptions by 20%, user retention by a lot as well.”
Grammarly nearly doubled upgrade rates by sampling paid features for free users
“All of a sudden people were seeing Gramly as a much more powerful tool than they were before, and our upgrade rates like nearly doubled just through this change.”
Duolingo strictly caps internal product reviews at 10 to 15 minutes
“They have templates for everything and like their product reviews are like 10 or 15 minutes. It's just people go in and out. So it's just, it's kind of a surreal environment about how rapidly and consistently they work.”
Cheng: Social marketing drove 20% to 30% of daily new users at Duolingo
“And then we would track back in the product experience. Like, how did you hear about us? And put all those channels in there. And some days it would be like, holy shit, like it's bringing in 20, 30% of like our new users in any given day.”
Cheng: LLMs are poor at playing chess and hallucinate moves
“You know, interestingly, LLMs themselves are quite bad at playing chess. Like they hallucinate moves. They look at patterns, right? They're very good at pattern recognition, but not so good at going super, super, super deep on a specific chess thing.”
Cheng: AI has not enabled PMs to ship production code yet
“We have not yet gotten to the point where like product managers themselves are actually shipping the code into production, but it's dramatically shortened the amount of time it takes to conceive of, especially like a bolder idea that you might have.”
Chess.com scaled from zero to 250 annual experiments in under two years
“So prior to 20, 23, the company practically didn't experiment at all.
Last year they did about 50.
This year they're
On pace for about 250.
And then next year we have that ambitious target of a thousand.”
Losing a first game on Chess.com reduces new user retention by 10%
“Less than a third of those users actually win their first game. And when you lose a game, user retention is 10% worse than when you win a game.”
Cheng: Over 90% of Grammarly users are on the free tier
“The Grammarly is a freemium business model, which means that over 90% of our users are on the free service and the rest of it pay for subscriptions essentially.”
Cheng: Chess.com active users are ~80% existing, with new and resurrected users equal
“I think probably eighties percent of our Daily or weekly active users. I mean, I'll check the numbers, but something like that would be like a current user or an existing user, and then a new and a like reactivated or resurrected user. Those are actually about…”
Cheng: Atlassian report shows 40% of product teams do not experiment
“I just read this Alassian
state of product report.
And it was like, 40% of product teams, like basically don't run experimentation at all.”