The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 9 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Chen: Researchers Degrade AI Factuality Just to Boost LMSYS Rankings
“A lot of researchers, they'll tell us that their VPs make them focus on increasing their rank on LMSYS. And so I've had researchers explicitly tell me that they're okay with making their models worse. Add factuality works at following instructions as long as i…”
Chen: Meta's Deal With Scale AI Actually Benefited Surge AI
“It's been beneficial because yeah, there were still some legacy teams using scale. Like they just didn't know about us because we were still pretty under the radar.”
Chen: The Easiest Way to Boost LMSYS Rank Is Longer Responses
“Like one of the things that we found is that the easiest way to improve your rank on album arena is the ability to make your model response longer.”
Chen: Surge AI Is Largest Human Data Player in AI
“We are kind of like the biggest human data player in this space.”
Chen: Most AI Data Competitors Are Non-Technical Body Shops
“A lot of other companies in this space, they are essentially just body shops. What they are delivering is not data. They are literally just delivering warm bodies to companies. And so what that means is like at the end of the day, they don't have any technolog…”
Chen: Surge AI Heavily Uses Synthetic Data to Supplement Human Labelers
“Like we use it like a ton ourselves in order to supplement what the humans do.”
Chen: Surge AI Works With All Frontier Labs on Model Evaluation
“So internally we do a lot of work actually today with working with all the frontier labs to help them understand their models. So again, we're constantly evaluating them. We're constantly surfacing loss areas for them to improve on and so on and so on.”