Salva: AI code completion latency sweet spot is roughly 200 milliseconds
Ryan J. Salva · The role of AI in new product development | Ryan J. Salva (VP of Product at GitHub) · Sep 4, 2022 · at 26:09
Ryan J. Salva, VP of Product at GitHub, explains findings from GitHub's internal UX experiments during the incubation of GitHub Copilot.
0:00 / 0:11exact quote · 11.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“It seems like right now it's around 200 milliseconds. So depending upon where you're in the world, your latency can go up or down a little bit from there, but it seems like the sweet spot is somewhere around 200 milliseconds.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ryan J. Salva
Salva: GitHub Copilot Will Never Replace Developers
“Copilot is not a replacement for a developer. It will never be.”
OpenAI scraping GitHub repositories initially appeared to be a DoS attack
“And at the time, one of the teams that I was responsible for was GitHub's infrastructure team. You know, the team responsible for our data centers, our reliability, our uptime. And we noticed one day that we were getting hammered. I mean, absolutely hammered w…”
GitHub provided its Arctic Code Vault to OpenAI for model training
“And so what we did is just like the year before that, we had actually created a snapshot. Of GitHub's public code for what we call the Arctic code vault, right?... Well, we took that same data snapshot and we brought it to our friends over at OpenAI to see lik…”
Salva: Early R&D teams should not be held to revenue or production standards
“Don't expect any, anything out of them that is going to turn into a moneymaker or something that is going to be beholden to fundamentals around security, privacy, uptime, you know, accessibility, all that groupy kind of stuff upfront. They need space to create…”
Salva: Copilot sustains developer flow by eliminating Stack Overflow and doc lookups
“Copilot.
Helps developers stay in the flow by bringing all of that information into the editor, preventing them from having to go check out documentation or watch a tutorial or go to Stack Overflow and, you know, either find an answer or worse, have to ask a q…”
Salva: AI will be core to the developer toolchain by 2026
“Students build not only the kind of the tool, the software that the business needs, and then get to put that on their resume and their, you know, application for college and university, but they also get to learn by kind of using the tools that likely are goin…”