Prediction certainty 3/5 debate potential 2/5

Chen: Synthetic RL Environments Alone Won't Meet Future Frontier AI Demand

Edwin Chen · No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen · Jul 24, 2025 · at 16:59

Surge AI founder Edwin Chen responds to Sarah Guo's question about whether RL environments or expert reasoning traces will dominate AI training demand over the next 5 to 10 years.

0:00 / 0:30exact quote · 30.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Like, I don't think our environments alone will suffice just because, I mean, it depends on how you think about our environments, but oftentimes these are very, very rich trajectories are very, very long. And so it's almost like inconceivable that a single reward I mean, I think even today, we often think about things in terms of multiple rewards, not just a single reward, but a thing like a single reward and we just may not be like rich enough to capture all the work that goes into like the model solving some like very, very complicated goal. So I think it'll probably be a combination of all those.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Edwin Chen

Assertion Not checkable as stated
Chen: Researchers Degrade AI Factuality Just to Boost LMSYS Rankings
“A lot of researchers, they'll tell us that their VPs make them focus on increasing their rank on LMSYS. And so I've had researchers explicitly tell me that they're okay with making their models worse. Add factuality works at following instructions as long as i…”
Edwin Chen Jul 24, 2025 ▶ 27:09 No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen
Opinion
Chen: Many YC Founders Only Care About Fundraising Brags and Headlines
“Like, if you talk to a bunch of YC founders or whoever it is, like, what is their goal? It really is to tell all their friends that they raised ten million dollars and show their parents they got a headline on TechCrunch. Like, that is their goal.”
Edwin Chen Jul 24, 2025 ▶ 3:04 No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen
Opinion
Chen: LMSYS Chatbot Arena is a giant plague on AI
“One of the things I think is a giant plague on AI is Elimsis, Elimarena.”
Edwin Chen Jul 24, 2025 ▶ 19:40 No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen
Assertion Not checkable as stated
Chen: Surge AI Is Largest Human Data Player in AI
“We are kind of like the biggest human data player in this space.”
Edwin Chen Jul 24, 2025 ▶ 0:55 No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen
Opinion
Chen: Most AI Data Competitors Are Non-Technical Body Shops
“A lot of other companies in this space, they are essentially just body shops. What they are delivering is not data. They are literally just delivering warm bodies to companies. And so what that means is like at the end of the day, they don't have any technolog…”
Edwin Chen Jul 24, 2025 ▶ 9:55 No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen
Opinion
Chen: Meta's Deal With Scale AI Actually Benefited Surge AI
“It's been beneficial because yeah, there were still some legacy teams using scale. Like they just didn't know about us because we were still pretty under the radar.”
Edwin Chen Jul 24, 2025 ▶ 23:52 No Priors Ep. 124 | With SurgeAI Founder and CEO Edwin Chen
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.