Assertion Supported
Brockman: Elon, Sam, Ilya, and I Agreed OpenAI Needed For-Profit Structure
“Elon, Sam, Ilya, and I all agreed. That the only path forward for OpenAI, the only path to achieve the mission, was to create a for-profit entity associated with OpenAI of some form. And so we were committed to that direction, and that is something that we kne…”
Assertion Not checkable as stated
Brockman: OpenAI board gave zero explanation when firing Altman and removing Brockman
“I was told that the board has decided That Sam would be removed, and effectively the message that I got was the same messaging that was in the public post, and I asked if I could have any more information. I was told no, not right now, and I pressed on that ma…”
Insight
Brockman: Predicting Einstein's Next Words Requires Intelligence Equal to Einstein
“On the one hand, just predicting what comes next sounds like a pedestrian task, but if you really can predict the next word out of Einstein's mouth, you are at least as smart as Einstein.”
Assertion Supported
Brockman: OpenAI models recently resolved an open quantum physics problem
“If you look at math and physics, we now are solving open math problems. We're solving Open physics problems and actually have resolved this particular physics problem recently in quantum physics in the opposite way that the community expected.”
Disclosure
Brockman: OpenAI hides chain of thought to preserve faithfulness and prevent distillation
“So there's two reasons. One is to think about distillation, but the second, in some ways more important, is that we had this insight when we first developed the reasoning paradigm that it gives us a interpretability mechanism we had not been anticipating, beca…”
Opinion
Brockman: OpenAI competitors are struggling with compute availability
“I mean, I think our competitors are not having a good time on compute, let me put it that way.”
Assertion Not checkable as stated
Brockman: Claims that OpenAI data centers consume massive water are misinformation
“Like a good example is data centers and water usage. Like that, that's something that people talk about a lot, but actually our data centers use incredibly little water, right? That's actually misinformation that they use a lot.”
What-if
Brockman: GPT-4 met previous AGI criteria despite clearly not being AGI
“It clearly wasn't an AGI. It was lacking something, but just if you'd describe your criteria for AGI two months prior, it probably would have been compatible with what GPT-IV was”
Prediction Not checkable as stated
Brockman: AI will soon invent its own research ideas and run experiments
“And we're going to be hitting a phase soon where the AI will also come up with its own research ideas and test those out, run experiments.”
Assertion Not checkable as stated
Brockman: Code written without AI is now a vanishing fraction
“It's hard to know what percent of the code is not written by AI. It's a vanishing fraction. The actual Writing of code. Currently, the AI is much better than humans at writing code, given the right context, given the right structure. Now there's parts of the a…”
Assertion Not checkable as stated
Brockman: OpenAI models previously leaned into sycophancy before training adjustments
“We've actually gone through an evolution of how we train the models to user preferences, and that we've seen that at one point, like last year, that the models really did start to lean into telling you what you wanted to hear, saying, oh, that's such a great a…”
Opinion
Brockman: Distilling AI models fails because frontier progress is exponential
“There's certainly a lot of attempts to distill models. And that comes from companies in the U S it comes from all over the world. But I think that it misses the core point, which is that the way this technology is developing is it is on an exponential. And any…”
Prediction Not checkable as stated
Brockman: The world is heading into severe compute constraints
“I would say that we, in general, are heading to a compute-constrained world.”
Prediction Not checkable as stated
Brockman: Data centers dedicated to curing cancer could emerge this year
“I think that this kind of thing happening this year is not out of the question.”
Opinion
Brockman: AI Users Need Legal Privilege Protections Similar to Doctors and Lawyers
“You talk to a doctor, you talk to a lawyer, those are privileged conversations, right? You feel comfortable sharing them. There's certain guardrails on when the healthcare provider would have to, you know, provide that information to law enforcement or alert s…”
Prediction Not checkable as stated
Brockman: People will manage AI agents and lead autonomous AI corporations
“We're all going to be heading to a world where we're managers of agents and soon maybe The CEO of an autonomous AI corporation, right?”
Prediction Not checkable as stated
Brockman: Everyone will have a pocket AI doctor superior to top medical teams
“We should be in a world, if we do our job right, where everyone gets access, has a doctor in their pocket that is better than any team of doctors today, the world's best doctors, they're there for you, they care about you, they're actually reading your charts,…”
Assertion Not checkable as stated
Brockman: OpenAI's 10-year roadmap focused on RL, unsupervised learning, then complexity
“We came up with what I would Really say is almost the technical plan that we have pursued for the past 10 years. Number one, solve reinforcement learning. Number two, solve unsupervised learning. And number three was gradually learn more complicated, in quotes…”
Disclosure
Brockman: OpenAI Uses Same Prediction Technology for Unsupervised and RL Stages
“Fundamentally the technology that we use to train during unsupervised stage and during the reinforcing stage, they're exactly the same. You are just predicting, but you've changed the structure of the data.”
Insight
Brockman: Belief in Human-Level AI Turns Mundane Politics Into Existential Conflict
“If you truly believe in the possibility of creating machines that have the intelligence level of humans, It means the stakes always feel very high. The question of who's making the decision, the question of what are the values that go into those decisions, the…”
Assertion Supported
Brockman: Altman, Pachocki, Sidor, Madry, and Brockman Charted New AI Venture
“There were a few of my close collaborators who quit that day as well. That's Jakob, Shimon, Alexander, and the five of us. So Those people plus Sam. We all got together and we started to chart out what a new company could look like.”
Assertion Supported
Brockman: Altman Asked Satya Nadella to Fund Venture Absorbing All OpenAI Staff
“Sam talked to Satya, who we'd been talking about. Hey, can you be a funder? Could you know, help, help support this new endeavor? I was like, Hey, actually, can we expand from the small life raft to like, yes, can we take everyone? And we're like, all right, w…”
Disclosure
Brockman: Sutskever leaving was the only time I considered quitting OpenAI
“And honestly, just one of the hardest moments for me at OpenAI was when Ilya left. And it was maybe the only moment in OpenAI's history where I felt like I didn't want to do it anymore.”
Insight
Brockman: Building true value requires enduring suffering
“Ilya always says that you have to suffer, right? If you're not suffering, like you're not building value. And I think there's deep truth to it.”