Everything Mark Chen said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Chen: Nearly all large language models today utilize mixture of experts
“I think pretty much all large language models today use, utilize mixture of experts.”
Mark Chen: Paper replication is the best way to develop AI research taste
“The best mechanism I've found for developing that is really just replication. So I think you should take papers that you really look up to, and just try to fully replicate it.”
OpenAI's Chen: Reinforcement learning struggles in subjective, hard-to-grade fields
“RLs traditionally had headwinds when it's come to fields that, you know, it's more kind of, Subjective than objective. So if you kind of think of, you know, one kind of, you know example of this is creative writing, where, you know, you could take two pieces o…”
Chen: Compaction shortcuts expensive native long context in coding products
“Many, many coding products today have features like compaction, right? Where you can compress kind of either insights or working state and stuff like that, you know, it just shortcuts a lot of the very brutally difficult and expensive permit is that you have t…”
Chen: The future of scientific discovery will be 'vibe researching'
“I do think, you know, the future hopefully will be vibe researching.”
Chen: The future of AI will center on reasoning and agents
“So we think the future is about reasoning, more and more about reasoning, more and more about agents.”
Chen: Competitive coding and math benchmarks predict future research success
“I mean, I think it is important to note that these evals like you know, IOI, AtCoder, IMO are actually real world markers for success in future research.”
Chen: Reasoning provides essential robustness for long-horizon AI agents
“Reasoning is core to this ability to operate over a long horizon, because, you know, you imagine kind of yourself solving a math problem, where you try an approach, it doesn't work, and, you know, you have to think about, you know, what, what's the next approa…”
Chen: Earlier Codex models spent too little time on hard problems
“What we found is the latest, the previous generation of the codex models, they were spending too little time solving the hardest problems and too much time solving the easy, easy problems. And I think that, that is actually just probably out of the box what yo…”
Chen: Direct reports at OpenAI are unaffected by tech talent wars
“Like when I look at my direct reports they haven't been affected by the talent wars.”
Chen: OpenAI historically prioritized algorithmic advances over product research
“I think historically we've put a little bit more on just the core algorithmic advances versus kind of the product research.”
Chen: AI labs risk second-place outcomes without strict strategic prioritization
“I think the danger is you end up like second place at everything and, you know, not like, you know, clearly leading at anything. So I think prioritization is important, right? And you need to make sure there's some things you're clear eyed on. This is the thin…”
Chen: No research leader at OpenAI feels they have enough compute
“There's no one who's like, ah, you know, I have all the compute that I need.”
Chen: Jakub Pachocki should be ranked as the top AI researcher
“I think, you know any of these rank lists, like he should be number one. Like just his ability to, you know, take any very difficult technical challenge and almost like personally just kind of think about it for two weeks and just crush it.”
Chen: OpenAI reached 3 million paying business users
“We hit a big milestone. We got I think three million paying business users fairly recently.”
Mark Chen: Compute Can Scale Heavily into RL Given Right Levers
“I think, like, if you find the right levers, you can really pump a lot of compute into RL as well as pre-training.”
Chen: GPT-4.5 outshines reasoning models like o1 in creative writing
“And, you know, we find that in a lot of areas like creative writing, for instance
Again, this is stuff that we want to test over the next one or two months but we find that there are areas like creative writing where this model outshines reasoning models.”
Chen: Pausing and restarting training runs is standard across OpenAI models
“Actually, so I think it's interesting that this gets is a point that's attributed to this model because actually in, in, in developing all of our foundation models, right they're all experiments, right? I think you know, running all of the foundation models of…”
Chen: GPT-4.5 creates ASCII art almost flawlessly, unlike previous models
“If you ask any of the previous models to create ASCII art for you, right? Actually, they mostly just fall down. This one can do it Almost flawless.”
Mark Chen brought soup to researchers to counter Zuckerberg's talent poaching
“Oh, you know, it's absolutely a true story. And I have brought soup to our own researchers.”
OpenAI's three research pillars are pre-training, RL, and alignment
“At the very highest level, right, we have an org that focuses on pre-training, right, which is, you know, giving models a lot of world knowledge. We focus on RL, like, teaching the models how to reason with that knowledge, how to chain the little insights toge…”
Chen: OpenAI inference costs dropped orders of magnitude since GPT-4
“The costs have dropped, you know, many orders of magnitude since we first launched GPT-IV.”