Assertion Not checkable as stated
Brockman: AI models are reaching parameter counts comparable to human synapses
“It's a hundred T synapses, which kind of corresponds to the weights of the neural net. And so there's some sort of equivalence there. And so we're starting to get to the right numbers. Let me just say that.”
Assertion Not checkable as stated
Brockman: Physicists say GPT-5 re-derived research insights taking months of work
“We've seen physicists starting to kick the tires on GPT-V and say that, like, hey, this thing was able to get, this model was able to re-derive an insight that took me many months worth of research to produce.”
Opinion
Brockman: AGI will be a menagerie of models, not a single model
“The flip side, though, is that I think that the evidence has been away from having the final form factor, the AGI itself being a single model. But instead thinking about this menagerie of models that have different strengths and weaknesses.”
Insight
Brockman: Open-source AI creates tech stack dependency beneficial to OpenAI and the US
“Another thing at a very practical level that we've thought about with open source models is that people building on our open source model are kind of building on our tech stack, right? If you are relying on us to help improve the model that you're relying on u…”
Insight
Brockman: AI developer productivity gains will increase demand for engineers
“The productivity impacts of people being able to do more means we actually want more people, right? It's like we are so limited by the ability to produce software, so limited by the ability of our team to actually clean up tech debt and go and refactor things,…”
Opinion
Brockman: AI infrastructure buildout dwarfs Apollo program and New Deal
“The engineering project that we collectively as a country, as a society, as a world are undergoing right now, right? It's like projects like the New Deal, like pale in comparison, you know, the Apollo program pale in comparison to what we're doing right now.”
Prediction Not checkable as stated
Brockman: Post-AGI humans will survive without work, but compute will differentiate capability
“And so I think that the question of exactly how, you know, if you don't do work, do you survive?
I think the answer will be yes.
You'll have plenty of material, your material needs met.
But I think the question of
Can you do more?
Can you have not just generat…”
Assertion Not checkable as stated
Brockman: GPT-4 handled multi-turn chat without being trained on it
“We actually did a instruction following post-train on it, so it was really just a data set that was, here's a query, here's what the model completion should be, and I remember that we were like, well, what happens if you just follow up with another query? And …”
Insight
Brockman: As AI capability increases, the value of generated tokens scales dramatically
“One thing that Ilya used to say a lot that I think is, is, is very, very astute is that when the models are not very capable, right? That the value of a token that they generate is very low. When the models are extremely capable, the value of a token they gene…”
Assertion Not checkable as stated
Brockman: Wet lab tests of o3 produced mid-tier journal-level work
“We have wet lab scientists who took models like O-three, ask it for some hypotheses of, here's an experimental setup, what should I do? They have five ideas, They tried these five ideas out, four of them don't work, but one of them does. And the kind of feedba…”
Insight
Brockman: Neural networks learn biological language as naturally as human text
“Why should human language be any more natural to a neural net than biological language? And the answer is, they're not, right? That, that actually these things are literally the same hardware. Exactly, and so one of the amazing hypotheses is that it's like, we…”
Assertion Partly supported
Brockman: Arc Institute trained 40B DNA model on 13T base pairs
“I'd say that maybe the neural net we produced, you know, it's a 40 B neural net trained on, you know, like 13 trillion base pairs or something like that. The results to be felt like GPT one, maybe starting to be GPT two level, right? It's like accessible or, a…”
Assertion Not checkable as stated
Brockman: GPT-5 performs exceptionally well at front-end software engineering tasks
“GP five is very good at front end, it turns out.”
Assertion Not checkable as stated
Brockman: GPT-5 is OpenAI's most personalizable model to date
“And GPT-V itself is extremely good at instruction following. And so it actually is the most personalizable model that we've ever produced. You can have it operate according to whatever you prefer, just by saying it, just by providing that instruction.”
Assertion Not checkable as stated
Brockman: LLMs consistently generalize to untrained preferences
“In order to get them to be able to operate according to different preferences and values, we just need to show that to them during training, and they are able to sort of generalize to different preferences and values that we didn't actually train against, and …”
Assertion Not checkable as stated
Brockman: OpenAI is compute-limited, preventing further price cuts for now
“Right now we are extremely compute limited, and so I think that if we were to cut prices a lot, it wouldn't actually increase the amount that this model's used.”
Insight
Brockman: AI models must build persistent tool libraries to solve hard problems
“But the idea of producing your own tools to make you more efficient and build up a library of those over time in a persistent way, like that's an incredible primitive to have in your toolbox. And I think that if your goal is to be able to go and solve these in…”
Prediction Not checkable as stated
Brockman: AI models will soon get very good at CUDA kernels
“Things like Cuda kernels are a good example of a very self-contained problem that actually our models should get very good at very soon, but it's just difficult because it requires a lot of domain expertise, a lot of like real abstract thinking. But again, it'…”
Assertion Supported
Brockman: OpenAI's robotics team pivoted to build GitHub Copilot
“And we've been through times where, for example, robotics was one in 2018, where we had a great result, but we kind of realized that actually, like, that we can move so much faster in a different domain, right? That, that actually, you know, we had this great …”
Insight
Brockman: Math reasoning and proof capabilities transfer directly to competitive programming
“Learning how to solve hard math problems and write proofs turns out to actually transfer to writing program and competition problems.”
Prediction Held up
Brockman: Most AI compute will shift from training to inference
“We're going to move from a world where most of the compute is training the model as we've deployed these models more, you know, more of the compute goes to inferencing them and actually using them.”
Insight
Brockman: Software developers should manage multiple concurrent AI agents instead of one
“Because you don't want to just have one instance of the model operating. You want to have multiple, right? You want to be a manager of not an agent, but of agents.”
Assertion Not checkable as stated
Brockman: OpenAI's 80% o3 price cut yielded neutral or positive revenue
“And you can see it with O three, I think we did like an 80% price cut and actually the usage grew such that it was like, I think in the revenue, it either was neutral or positive.”
Prediction Not checkable as stated
Brockman: Future dev architecture will combine local, remote, and multiplayer agents
“And then you have your codex infrastructure that has a local agent and a remote agent, and that is able to seamlessly, you know, interplay between the two and then is able to multiplayer. Like, this is what the future is going to look like, and it's going to b…”