Khan: Product managers can extract customer pain points using long-context LLMs
Aman Khan · Becoming an AI PM | Aman Khan (Arize AI, ex-Spotify, Apple, Cruise) · Nov 14, 2024 · at 1:02:32
Aman Khan, Director of Product at Arize AI, explains how individual contributor PMs can scale their customer research by analyzing Gong sales call transcripts with LLMs.
0:00 / 0:16exact quote · 16.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“What I can do is take those transcripts and we literally did this. We fed them into some of these large language models that have super long context windows now. And what you can do is actually pull out what's the most common problems that come up, you know, ask, having a conversation around that can be really powerful too.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Aman Khan
Khan: Breaking into AI PM is easier now than before
“I actually think it's probably easier now to break into AI product management than it was before. So let me kind of hit on that point a little bit more, which is before you actually probably needed to have more of a foundation and background in machine learnin…”
Khan: AI product managers hold the highest-leverage role in tech companies
“Being an AI product manager feels like the highest leverage position you could be in at the company right now, especially in the age of AI.”
Khan: AI PMs should apply foundation models rather than invent agent frameworks
“That's the area where product managers can truly innovate, because let's be honest, you're probably not going to have those, these cutting edge researchers that can go and design a model from the ground up, or maybe design some new technique to build a next ag…”
Khan: The IKEA effect in AI requires giving users control levers
“You want to kind of leave some knobs and levers for your customer to feel like they're still in control of the experience. And that's kind of like the Ikea effect applied to AI. Like people feel more empowered when they can actually have an impact on the end e…”
Aman Khan: AI will become as standard as databases in SaaS
“It almost feels a little bit like AI will be as common as the database to some degree for SAS applications.”
Aman Khan: Most PMs will soon become some flavor of AI PM
“I kind of see in the future, you know, in the near future, most PMs are probably going to be one flavor of an AI product manager, either building tools for other PMs or other, other companies that are deploying AI. Maybe you're behind one of, you know, the cut…”