Hsu: Speak Summarizes User Onboarding Audio into Structured Goals via Secondary LLMs
Andrew Hsu · Personalized AI Language Education — with Andrew Hsu, Speak · Jul 11, 2025 · at 9:27
Andrew Hsu is CTO and co-founder of Speak, explaining the technical architecture behind conversational user profiling during onboarding.
0:00 / 0:19exact quote · 19.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The way it works is the tutor will ask you some sort of question, like, what are your goals around learning English or the language? And then we will basically use a separate LM prompt to summarize. So it's not the, like, full transcript for what you said that you see. It's more of, like, an abstracted, okay, here's what you care about. And we think that's a better product experience.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Andrew Hsu
Hsu: Real-time translation latency is blocked by language syntax rules
“The counterexample that I always have that I think is quite illustrative is in German, the verb is at the end of the sentence. So if you're trying to do real-time translation from German to English, as an example, you can't actually make any progress on the En…”
Hsu: 80% to 90% of Tech for Superhuman AI Tutors Exists
“It was that as speech models and language models become superhuman, that would let us create an AI language tutor that would help you become fluent faster than any human could. And I think we're like 80 to 90% of the tech is here now.”
Voice onboarding lowers app signups but boosts trial start rates
“The interesting thing is that in general, because it's speaking based, which is a much higher barrier than just like tapping a multiple choice button, what we see is that install to signup rate is a decent amount lower. But trial start rate is higher.”
Hsu: Conversational Onboarding Should Transition from State Machines to Natural LLMs
“I think that things should move in a direction where it's much more of a natural conversation.”
Hsu: Duolingo and Gen 2 language apps are comparable to mobile games
“Gen two was basically mobile. So you have these very casual, massively popular mobile apps like Duolingo that I think the comp there is probably closer to a mobile game, something that feels productive, something that's very engaging, very gamified.”
Hsu: Dropping a free tier sidesteps user motivation problems
“We also pretty critically, I think, abandoned the free version and just went straight premium. And we kind of sidestepped the motivation question that way, because we knew that there were a ton of users that really wanted to learn English and were already real…”