Foody: AI labs are broadly shifting from RLHF to RLAIF
Brendan Foody · Why experts writing AI evals is creating the fastest-growing companies in history | Brendan Foody · Sep 18, 2025 · at 15:44
Brendan Foody, CEO of Mercor, explains why leading AI labs are shifting their post-training and evaluation methodologies toward AI feedback.
0:00 / 0:41
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“What everyone is generally moving towards is reinforcement learning from AI feedback instead of human feedback, where you have instead the human defined some sort of success criteria, some way to measure that... And it's far more scalable and data efficient, and so that's why a lot of, you know, the broader trend in the market across the board is moving towards RLA-IF to both eval models as well as improved capabilities.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Brendan Foody
Foody: Success measurement bottlenecks economy-wide AI automation
“And so in many ways, the barrier to applying agents to the entire economy To automate every workflow is how do we measure success? How do we eval it and write the PRDs for everything that we want agents to do, which Mercore is obviously a huge part of doing.”
Mercor scaled from $1M to $400M revenue run rate in 16 months
“We grew from one to four hundred million in revenue run rate in 16 months, and it's been an extraordinary journey and super exciting.”
Foody: Human AI eval work will last as long as human advantages
“And I think that that road to improving models will last for as long as there is anything in the economy that humans can do, which models can't, and be a huge portion of what the future of work looks like.”
Foody: The entire economy will likely become an RL environment machine
“It speaks to conversations I've had with a lot of researchers and executives at top labs, which is that it's highly likely that the entire economy will become an RL environment machine.”
Foody: Some Fortune 500s fear evaluating AI automation in their businesses
“There are certain enterprises we talk to that are almost like fearful, not wanting to engage, not wanting to, you know, eval their businesses because that'll provide the evidence that their value chain is being automated. And there's others that, I mean, liter…”