Nitski: Top AI models score 50% on Mercor's long-horizon benchmarks
Osvald Nitski · Mercor Head of Product on Revenue Concentration from Frontier Labs · Jul 25, 2026 · at 5:18
Osvald Nitski, Chief Product Officer at Mercor, shares performance data from Mercor's Apex benchmarks evaluating AI models on complex, long-horizon tasks.
0:00 / 0:10exact quote · 10.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Well, in our Apex benchmarks, we're getting closer to around 50% of Long Horizon workflows. Top models are scoring around around that much.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Osvald Nitski
Nitski: Forward-deployed AI services are only a short-term enterprise trend
“I think it's the future for the short term as the knowledge of how to use AI gets disseminated throughout industry. We have basically a concentration of a bunch of people in San Francisco who really know how to deploy agents, eval agents, Be AI first in engine…”
Nitski: Mercor adds millions of dollars in cash to bank weekly
“It doesn't annoy me, no, because the, you know, we end every week with millions more in the bank, right? So it's funny how you can have, I've been at other Companies where I've seen, you know, interesting financial engineering and accounting, and people can ha…”
Nitski: Open-source AI does not cannibalize frontier data demand
“I wouldn't say that open source model improvements cannibalize our core business because data is most valuable on the frontier of model performance, so each of our customers has their own unique goals and is purchasing eval and training data sets To fill gaps …”
Nitski: Specialized AI models will require custom enterprise training data
“I buy it. I think it's also self-serving towards Mercore, in that we think that every specialized model will need enterprise specific eval and training data to show the model how it's performing in its setting, and I think it depends on I think the diversity a…”