Foody: Human data market will grow dramatically as RL requires ubiquitous evals
Brendan Foody · Brendan Foody on using AI to predict job performance and scaling from $1M to $100M in 11 months · Mar 24, 2025 · at 6:38
Mercor co-founder Brendan Foody argues that reinforcement learning progress increases rather than decreases demand for human evaluation data.
0:00 / 0:22exact quote · 22.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“My broader take on the human data market is that It's going to grow dramatically because, so we're getting to the point where RL is so effective that you can create almost any eval and it will be able to solve that eval. And so the barrier to applying AI throughout the entire economy is just creating evals for everything, right? Which is a process that inherently requires humans in the loop.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Brendan Foody
Mercor scaled from $1M to $100M in revenue in two years
“And then fast forward two years, we scaled from one to a hundred million in revenue, and so we're only 21 and running this really exciting company that's working with most of the most prominent companies in Silicon Valley.”
Foody: Single-line API switching makes pure model businesses hard to defend
“A lot of investors don't quite realize when they're not like in the code of building these products is how low the switching costs are for API, right? Like it's a line of code to switch back and forth and like see how new models are doing. And so it's hard to …”
Foody: AI data training shifted from low-skilled crowdsourcing to high-caliber expert vetting
“What we realized was that there was this really large shift happening in the human data market where large AI labs are hiring thousands of people to train the next generation of LLMs. And it used to be this crowdsourcing problem that was super low skilled, rig…”
Foody: Top AI labs are prioritizing data far beyond frontier model capabilities
“If you look at the most sophisticated labs and what they're really investing in, it's a super high caliber expert data that is like far beyond the model frontier of capabilities.”
Foody: Mercor hires Harvard Lampoon writers to train AI models on humor
“A lot of our customers at the frontier as you've seen in recent releases are starting to think a lot more about Humor and these exciting things. We have been hiring a bunch of people out of like the Harvard Lampoon and equivalent places that have these comedic…”
Foody: Ex-OpenAI founders prioritize AGI ideology over business unit economics
“I think a lot of it ties to just like the ideology around AGI, right? This is the most important problem in the world. And so how do we all race as fast as possible to get there rather than a lot of the, you know, unit economics and competitive dynamics that i…”