frontier labs

“The labs that are not that frontier will keep measuring themselves on last year's benchmarks. And then the labs that are actually frontier will tell you about benchmarks you've never heard of.”

“Every time I check in with people at frontier labs, they're like, yeah, we still use human preference data.”

“I think you, what you see in all the frontier labs is that they have data teams. And if you talk to the folks that work on those data teams, what you'll kind of systematically hear is that typically they're under resourced relative to the gains that they're de…”

“I think if you look from a business model perspective on this, I think at least right now, we are not planning to build our own models. I think ultimately that's a way out. You know, if you also are building your own models, we're not doing that. We are really…”

“I'm pretty bearish on like Hey, this is a model that is trained as an LMS judge, but it's a generic LMS judge that can be used to judge anything. I just don't think you're going to beat the frontier labs on that.”

“And with the Claude codes and the codec CLIs and the deep researchers, researchers, you starting to see some evidence that the products are going to be a much more central part of how these frontier labs operate.”

“I think like, I think this is the pattern for every frontier lab now.”

“It's used by all Frontier Labs in some capacity.”