Training OpenAI base models on code improved chain-of-thought reasoning
Alex Graveley · No Priors Ep. 10 | With Copilot's Chief Architect and founder of Minion.AI Alex Graveley · Apr 25, 2023 · at 15:28
Alex Graveley, Chief Architect of GitHub Copilot, describes OpenAI's early experiments introducing code into base language models.
0:00 / 0:09exact quote · 9.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So they had wanted to see what introducing code into their into their base models would do. I think it had positive effects on chain of thought reasoning.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Alex Graveley
Graveley: Bad actors with AI pose a bigger threat than AI existential risk
“I'm not really scared about AI is killing us, although I'm very grateful that there are people that are thinking about it. I'm more worried about bad people using new technology to hurt us.”
Graveley: Every 10ms of latency drops Copilot completions by 1%
“Every 10 milliseconds is one percent fewer completions that people would do.”
Graveley: Programmers think in blocks, making block autocomplete optimal
“The key insight was realizing that programmers kind of think in blocks. So if you can just autocomplete the rest of the current block, Then that's what people want. People can, they're kind of like judging what this block is going to do, and if it does the rig…”
Graveley: Copilot writes 80% of code for top power users
“There's some whales out there. Like there's people who it writes 80% of their code.”
Autonomous tax-filing AI agents are achievable within the next few years
“You want to make a thing where you say, hey, computer, file my taxes, and it does the right thing. You know, I think we can get there. That's certainly in the next few years you know.”
Graveley: Applied AI intuition is bimodal between junior and senior engineers
“You know, one thing, I don't know if other people have noticed this, but it seems very bimodal, like very senior people get it and very young people get it, and so I don't know that the middle has really caught up yet or realizes that, that .”