Codex

“Is we did the back of the envelope math for what Codex, the first coding model, costed to train. From my memory, it only cost about 90 K or a hundred K by our calculations.”

“But now you start to see things where you can like really give a task to Codex, for example or to deep research, and you have this thing go off and do a bunch of stuff and come back to you with like a proposal. It's like a very junior employee that can work on…”

“By our calculations, Codex, which was the first, this was the first autocomplete model behind GitHub Copilot, it didn't really cost that much money to train, even though, even back then, at kind of the beginning and middle of 2022, people were talking about ho…”

“Like I think cursor takes an approach where they actually do semantic search, where they embed everything and figure out like, Hey, what query is closest to this? If you look at a codex or a cloud code they actually just use like grep.”

“Hey, in the future coding is really going to feel more like talking to a coworker. Like you're going to send off a question and then they'll go off and do something and come back to you with a PR.”

“Where it will run compaction, like, periodically after each turn, and so Codex can continue to run for a very long time, and if you look at the percentage in the CLI, you'll see it, like, move up and down as compaction runs.”

“I use the cursor bug bot has gotten quite good and I actually like codex for code review as well. I find it does a very good job on correctness.”

“Codex works very well on Python mono repos.”

“Claude Code is ideal for the ADHD CEO, but once in a while, there's a, you know, Claude Code will just BS a bunch of stuff, like Claude models are very, very good, but like, they are not the smartest, it turns out.”