Edwin Chen: Easiest Way to Game Chatbot Arena Is Lengthy Responses
Edwin Chen · Surge CEO & Co-Founder, Edwin Chen: Scaling to $1BN+ in Revenue with NO Funding · 20VC with Harry Stebbings · Jul 21, 2025 · at 46:22
Edwin Chen is the founder and CEO of Surge, an AI data annotation company. He explains how model responses are optimized for leaderboard metrics rather than actual intelligence.
0:00 / 0:06exact quote · 6.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And so one of the, I mean, one of the things that we've learned is that the easiest way to improve in this arena is simply to make your model responses a lot longer.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Edwin Chen
Edwin Chen considers company acquisition an admission of failure
“Because yeah, getting acquired would be really limiting. It would be this admission of failure and jumping ship because you can't make it on your own anymore.”
Edwin Chen says he wouldn't sell Surge for $100 billion
“No, I mean, I definitely wouldn't sell for thirty billion or even a hundred billion.”
Surge AI CEO: 2,000 human data points beat 10 million synthetic ones
“A lot of them tell us that even a thousand or a couple of thousand pieces of really high quality human data that we generated for them, it's actually been worth more than ten million pieces of synthetic data.”
Edwin Chen: Most AI data competitors are body shops masquerading as tech
“I think a lot of the other companies in our space, they're just not technology companies at the end of the day. They are either body shops or they are body shops masquerading as technology companies.”
Edwin Chen: 100x engineers exist through multiplicative compounding of small advantages
“Some people are simply two to three times better, like two to three times faster than anybody else, right? They just code faster. There are some people who simply have two to three times more better ideas. There are people who simply work two to three times as…”
Edwin Chen: Silicon Valley fundraising is mostly a status game
“I think one of the things that's always driven me crazy about Silicon Valley is that it really is just a status game for most people. Like, People are just raising for the sake of raising. Their goal isn't to build some great product that solves an idea that t…”