Fisher: Economic pressure for long-horizon agents will drive AI alignment progress
Jordan Fisher · Ask These Questions Before Starting An AI Startup · Y Combinator · Oct 7, 2025 · at 18:19
Jordan Fisher, an AI alignment researcher at Anthropic and former Standard AI CEO, discusses how commercial incentives will force breakthroughs in model safety and control.
0:00 / 0:08exact quote · 8.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I'm actually really positive and bullish that there is this economic pressure in a good way To make progress on alignment because long horizon agents require it.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Jordan Fisher
Fisher: AGI is extremely likely to arrive within two to three years
“Cause it's extremely likely that we will have AGI in the next few years. Maybe it's not two, maybe it's three.”
Fisher: VCs Investing in AI Are Already Two Years Behind
“And I think even today, like you talked to a bunch of VCs and they're like, oh yeah, like I'm ahead of the curve. Like I'm investing in AI. I'm like, no, like you're two years behind already. Right. Like, tell me about what you think needs to happen in two yea…”
Fisher: Large enterprises are replacing SaaS purchases with AI-assisted internal builds
“Large enterprises sometimes aren't even going out and buying software from SAS providers anymore. They're like, I can just like Throw two people at cloud code and they'll build it and it'll be dedicated to the capabilities that I need for my organization.”
Fisher: Retrofitting Existing Products With Distribution May Beat AI-Native Startups
“It's natural to think it's better to build it a new product from the ground up that's AI native. Like that's like my startup mentality, like new technology revolution. You need to start from scratch if you want to build this right. But that might not be true. …”
Semi-automated companies allow single bad actors to act without human whistleblowers
“In a semi-automated world, that's no longer true. And it could be the fact that a single person could make a decision that changes the entire impact of a product. And there's no single person that might be aware of that except themselves. It gets extremely eas…”
Fisher: Post-AGI capital won't need labor buy-in, worsening wealth concentration
“But once AGI arrives, you don't need labor buy-in anymore. Right. Like you don't need folks like me to approve of the thing that you're building or of your morals or whatever. Right. Like capital begets capital in that world. And that can easily spiral out of …”