Alexander Embiricos, an engineer on the ChatGPT Codex team at OpenAI, explains the reasoning behind open-sourcing the tool and standardizing repository instruction files.
Insight
Embiricos: Scaffolding-heavy AI agents are limited by developers' mental capacity
“A lot of, like, agents that I see are really impressive, but it's basically, like, part of what's impressive is it's like a bunch of developers building this, like, really bespoke state machine around a bunch of, like, short model calls, and so then the upper …”
Insight
Embiricos: Benchmark-Passing SWE Agent Outputs Are Often Unmergeable in Practice
“Because if you look at a lot of, like, Sweebench passing, like, outputs from, like, an agent, they're not really, like, PRs that you would merge, because, like, the code style might be, like, different. Like, it works, but the code style is different.”
Prediction Not checkable as stated
Embiricos: Majority of Future Code May Be Written by Parallel AI Agents
“In, in a future world that we imagine where actually you know, maybe the majority of code is actually being written by agents that we're delegating to, you know, doing tasks in parallel. It becomes, like, critically important that you can actually, like, integ…”
Insight
Embiricos: Specialized domain training yields outsized returns in general models
“If you can, like, build, do something very specific for, like, a specific purpose, actually, when you bring that and you bring it into the generalized model, like, you might even get outsized returns on that. Because there's, like, transfer from all these diff…”
Insight
Embiricos: The best Codex users spend 30 seconds max prompt crafting
“The way we see people who, like, love Codex the most using it is they don't, they think for, like, maybe 30 seconds max about their prompt. It's just like, oh, I have this idea, like, boom. Oh, like, there's this thing I wanna do, like, boom. Oh, like, I just …”
Insight
Embiricos: Clean architecture is more important than ever with AI agents
“Good architecture is like even more important than ever. And like, I guess the fun thing is like for now, that's something that humans are really good at. So like, you know, kind of good, you know, important for the software engineers to do their job.”