McGrath: AI Frontier Is Bottlenecked by Shortage of Hybrid Systems-ML Talent
Josh McGrath · [State of Post-Training] From GPT-4.1 to 5.1: RLVR, Agent & Token Efficiency — Josh McGrath, OpenAI · Dec 31, 2025 · at 21:36
Josh McGrath, an OpenAI post-training researcher, discusses talent bottlenecks and frontier AI research skills with the Latent Space podcast hosts.
0:00 / 0:29exact quote · 29.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think we're still having trouble not at OpenAI, but I think as a whole, producing lots of people that do lot, want to do lots of both systems work and ML work. And I think if you're trying to push the frontier, you don't know which Place is currently bottlenecking the frontier, and it changes all the time. I mean, even within one project, it might change multiple times where the current bottleneck is. But I think the education system we have right now isn't really optimized for that.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Josh McGrath
McGrath: Specialized and Frontier Reasoning AI Models Will Eventually Converge
“You know, I think if you look at like deep research, the original one and GPT-Five thinking on like high reasoning today, I think you'll see that like eventually the models all sort of converge in their capabilities.”
McGrath: RLHF and RLVR differ by data quality, not optimization math
“Really, at the end of the day, like, RLHF, RLVR,
They're both policy gradient methods, but the, what's different is just like the input data.”
McGrath: DeepSeek Math's real breakthrough is verifiable reward trust, not GRPO
“As you said, it came out in the deep seek math paper, and like, it's an interesting optimization method, but it's like the more interesting thing that they have a new reward signal that they sort of like re that we can really, really trust. Like when, you know…”
McGrath: RL runs have far more infrastructure failure points than pre-training
“The issue with RL is, like, you're doing tasks, and each task could have, like, a different grading setup, and each one of those different grading setups, that's, like, more infrastructure, and so, You know, when I'm staying up late trying to figure out what's…”