Graveley: GitHub Copilot weekly cohort retention stayed above 50%
Alex Graveley · No Priors Ep. 10 | With Copilot's Chief Architect and founder of Minion.AI Alex Graveley · Apr 25, 2023 · at 28:04
Alex Graveley, Chief Architect of GitHub Copilot, reflects on user retention metrics following the product's launch.
0:00 / 0:09exact quote · 9.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Our retention rate was 50%. Like, it never went, like, months later, it was still above 50% by, like, weekly cohort, which is, like, insane.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Alex Graveley
Graveley: Bad actors with AI pose a bigger threat than AI existential risk
“I'm not really scared about AI is killing us, although I'm very grateful that there are people that are thinking about it. I'm more worried about bad people using new technology to hurt us.”
Training OpenAI base models on code improved chain-of-thought reasoning
“So they had wanted to see what introducing code into their into their base models would do. I think it had positive effects on chain of thought reasoning.”
Graveley: Every 10ms of latency drops Copilot completions by 1%
“Every 10 milliseconds is one percent fewer completions that people would do.”
Graveley: Programmers think in blocks, making block autocomplete optimal
“The key insight was realizing that programmers kind of think in blocks. So if you can just autocomplete the rest of the current block, Then that's what people want. People can, they're kind of like judging what this block is going to do, and if it does the rig…”