AI labs

“I think that's almost how I view like the future of application layer companies. Cause I mean, yeah, you see like the different, the labs are also now creating these like RL platforms and you can soon like customize models with RL on your personal, like on you…”

“I think they'll all do end up doing their own index and it should, it's one of those things that's like Google should have an advantage again, but who knows if they do.”

“At least the one, the startups that I talked to, a decent chunk of them are already starting to work with, like, the AI, the big AI labs, and, like, these are quite early startups, so it seems like they are very, the AI labs are very excited about this approac…”

“It seems to me like that definitely is a services heavy business at the moment as it, as it's presently constituted.”

“So like, right when that happened, a lot of the labs also started on, started understanding what we had. And so we started very aggressively, multiple labs tried to bring us in, in various ways.”

“I think that there will just be labs coming at this problem from both sides. And everyone ends up in roughly the same place, and the same place will be whatever people think is cool.”

“I think he comes from a particular position of extreme unusual privilege, which is that he works at an AI lab where like people in the office next door are like writing the evals and are like training the model like every day in exactly that way.”

“Well, it does seem like basically a lot of the labs have kind of like converged onto some similar-ish way of doing RL, and they're all kind of back at the same level of like Frontier again”

“We have what we call a mystery shopper policy, and so, and we're totally transparent with all the labs we work with about this, that we will register accounts not on our own domain and run both intelligence evals and performance benchmarks without them being u…”

“Like they have shipped models that were not the snapshots that we wanted, and they have changed the snapshots that they shipped based on the feedback that we give, because our feedback tends to be more enterprise work focused and not coding agent focused.”

“Most of the AI labs now have their own vending machine running, running a Claudius instance”

“And I think teams who can raise too much money too fast, too early, who don't have to define what the P zero is, because that's the only thing when you have scarce resources, you gotta invest in. Those cultures end up being the most fragile and brittle, and th…”

“The hyperscalers and the, you know, the biggest the biggest AI labs are buying 95 plus percent of it, right? And then you kind of have the startups, like, fighting over the scraps.”

“Yeah, I mean, I think up until I think three months ago, right, GLP one's like total revenue was more than all of the AI labs put together.”