Surge AI

“Like we use it like a ton ourselves in order to supplement what the humans do.”

“It's been beneficial because yeah, there were still some legacy teams using scale. Like they just didn't know about us because we were still pretty under the radar.”

“So internally we do a lot of work actually today with working with all the frontier labs to help them understand their models. So again, we're constantly evaluating them. We're constantly surfacing loss areas for them to improve on and so on and so on.”

“And we're about a hundred, a little over a hundred people.”

“A lot of researchers, they'll tell us that their VPs make them focus on increasing their rank on LMSYS. And so I've had researchers explicitly tell me that they're okay with making their models worse. Add factuality works at following instructions as long as i…”

“Like one of the things that we found is that the easiest way to improve your rank on album arena is the ability to make your model response longer.”

“We are kind of like the biggest human data player in this space.”

“A lot of other companies in this space, they are essentially just body shops. What they are delivering is not data. They are literally just delivering warm bodies to companies. And so what that means is like at the end of the day, they don't have any technolog…”

“I think we were very, very lucky to be profitable from the start. So we didn't need the money. It always felt weird to give up control.”