Prediction certainty 4/5 debate potential 3/5

Pachocki: OpenAI's primary research target is building an automated researcher

Jakub Pachocki · From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki · Sep 25, 2025 · at 0:00

Jakub Pachocki is Chief Scientist at OpenAI. He outlines OpenAI's strategic direction toward automating scientific research and evaluating AI models on economically impactful tasks.

0:00 / 0:12exact quote · 13.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The big thing that we are targeting is producing an automated researcher. So automating the discovery of new ideas, the next set of evals and milestones that we're looking at will involve actual movement on things that are economically relevant.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Jakub Pachocki

Assertion Not checkable as stated
Pachocki: Standard AI evaluation benchmarks are close to saturation
“One thing is that indeed for like these e-files that we've been using for the last few years, they're indeed pretty close to saturated.”
Jakub Pachocki Sep 25, 2025 ▶ 2:44 From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki
Prediction Not checkable as stated
Pachocki: AI models will soon conquer the hardest math and programming problems
“If you look at things like Well, I guess the IMO problem six, or maybe some very hardest programming competitions problems. Like, I think there's still a little bit of headway to go for the models, but I wouldn't expect that to last very long.”
Jakub Pachocki Sep 25, 2025 ▶ 18:39 From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki
Prediction Not checkable as stated
Pachocki: AI progress will remain compute-constrained rather than data-constrained
“I haven't really bought that much into the, like, will be data constraint claim. And yeah, I don't expect that to change.”
Jakub Pachocki Sep 25, 2025 ▶ 41:00 From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki
Prediction Not checkable as stated
Pachocki: AI progress over the next year will dwarf current gains
“But I expect that well, now as we're seeing you know, these models like actually able to automate, well, yes, like we're saying solving contest problems over, over longer time horizons. I expect that that is, well, that's, that, that was quite small compared t…”
Jakub Pachocki Sep 25, 2025 ▶ 6:52 From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki
Assertion Not checkable as stated
Pachocki: Current OpenAI models can perform one to five hours of reasoning
“And so now, as we kind of, like, get to a level of near mastery of this high school competitions, let's say, I would say, like, we get to, like, maybe on, on the order of one to five hours, Of reasoning.”
Jakub Pachocki Sep 25, 2025 ▶ 7:53 From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki
Insight
Pachocki: Long-horizon AI research blurs verifiable and open-ended domains
“I think if you actually truly want to extend to research and, you know, finding, discovering ideas that, that meaningfully advanced technology on the, on, you know, the scale of like months and years, like I think the, these questions like stop being so differ…”
Jakub Pachocki Sep 25, 2025 ▶ 10:37 From Vibe Coding to Vibe Researching: OpenAI’s Mark Chen and Jakub Pachocki
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.