Chen: AI RL Environments Are Too Complex to Create Synthetically
Edwin Chen · No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen · Jul 24, 2025 · at 14:20
Surge AI founder Edwin Chen discusses the operational difficulties of building rich reinforcement learning environments for frontier AI lab training.
0:00 / 0:05exact quote · 6.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think one of the things that people really underestimate is how it is, how complicated it is that you can't just synthetically generate it.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Edwin Chen
Chen: Researchers Degrade AI Factuality Just to Boost LMSYS Rankings
“A lot of researchers, they'll tell us that their VPs make them focus on increasing their rank on LMSYS. And so I've had researchers explicitly tell me that they're okay with making their models worse. Add factuality works at following instructions as long as i…”
Chen: Many YC Founders Only Care About Fundraising Brags and Headlines
“Like, if you talk to a bunch of YC founders or whoever it is, like, what is their goal? It really is to tell all their friends that they raised ten million dollars and show their parents they got a headline on TechCrunch. Like, that is their goal.”
Chen: LMSYS Chatbot Arena is a giant plague on AI
“One of the things I think is a giant plague on AI is Elimsis, Elimarena.”
Chen: Surge AI Is Largest Human Data Player in AI
“We are kind of like the biggest human data player in this space.”
Chen: Most AI Data Competitors Are Non-Technical Body Shops
“A lot of other companies in this space, they are essentially just body shops. What they are delivering is not data. They are literally just delivering warm bodies to companies. And so what that means is like at the end of the day, they don't have any technolog…”