Salva: GitHub Copilot is powered by OpenAI's Codex, derived from GPT-3
Ryan J. Salva · The role of AI in new product development | Ryan J. Salva (VP of Product at GitHub) · Sep 4, 2022 · at 11:55
Ryan J. Salva, VP of Product at GitHub, explains the technical foundation and architecture of GitHub Copilot.
0:00 / 0:18exact quote · 19.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Copilot is essentially that magnified by many lines of code. It is multi-line autocomplete that is Fundamentally powered by an AI model called Codex, which is a derivative of another kind of one that you might be familiar with, GPT-III.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ryan J. Salva
Salva: GitHub Copilot Will Never Replace Developers
“Copilot is not a replacement for a developer. It will never be.”
OpenAI scraping GitHub repositories initially appeared to be a DoS attack
“And at the time, one of the teams that I was responsible for was GitHub's infrastructure team. You know, the team responsible for our data centers, our reliability, our uptime. And we noticed one day that we were getting hammered. I mean, absolutely hammered w…”
GitHub provided its Arctic Code Vault to OpenAI for model training
“And so what we did is just like the year before that, we had actually created a snapshot. Of GitHub's public code for what we call the Arctic code vault, right?... Well, we took that same data snapshot and we brought it to our friends over at OpenAI to see lik…”
Salva: Early R&D teams should not be held to revenue or production standards
“Don't expect any, anything out of them that is going to turn into a moneymaker or something that is going to be beholden to fundamentals around security, privacy, uptime, you know, accessibility, all that groupy kind of stuff upfront. They need space to create…”
Salva: Copilot sustains developer flow by eliminating Stack Overflow and doc lookups
“Copilot.
Helps developers stay in the flow by bringing all of that information into the editor, preventing them from having to go check out documentation or watch a tutorial or go to Stack Overflow and, you know, either find an answer or worse, have to ask a q…”
Salva: AI will be core to the developer toolchain by 2026
“Students build not only the kind of the tool, the software that the business needs, and then get to put that on their resume and their, you know, application for college and university, but they also get to learn by kind of using the tools that likely are goin…”