Carson ships three PRs daily from an autonomous AI grading loop
Ryan Carson · Most Valuable Skill of 2026: Managing AI Agents · Jul 24, 2026 · at 33:27
Ryan Carson explains how Untangle automates self-improvement by evaluating AI paralegal transcripts and generating pull requests for detected issues.
0:00 / 1:07exact quote · 67.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Every day I have an automation that looks at these chats and then grades them on a rubric. And so you, and again, just talk to your agent about this. You pick the most important part of your app that you want to self-improve and say, here's how you agent judge whether this thing that happens is good or bad. And then every day I want this automation to kick off. Look at those things for us. They're conversations that Grace is having, and then I want you to grade them, and then if anything is bad or below this score, I want you to kick off a child session and fix it. And it is shocking to me the number of small, you know, fine UX details that have been picked up by this loop and have been fixed. And honestly, there are things that I just wouldn't bother doing. Either I didn't know about them, or I'd be like, meh, you know, it's a paper cut. Like, are we really gonna, you know, ship a fix to that? But because the agent already identified it, spun up a PR, and it's ready to ship, I just go, ship it. And, you know, we probably ship, I would say, probably three of these a day.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ryan Carson
Carson: Engineers coding locally are cavemen shipping 10x less code
“So I think if you are working locally, I honestly think you are a caveman. Like, I think you're, you are holding yourself back, and you are shipping 10 X less than you could be, and it is not smart. No matter if you think the cool people work locally and all t…”
Carson: The AI agent era requires working more, not less
“And in in order to survive in this new world, you're going to work a lot more, not a lot less.”
Carson warns against building workflows on frontier models to avoid lock-in
“Like, if you are, if your whole engineering you know, motion is happening inside of clock code or inside of codex, What are you doing? Like, because they are not incentivized to make it reasonable for you long term, right? They're going to lock you into their …”
Carson: AI agents will write, review, and ship 100% of code
“You will be using a software factory. Like, and what I mean is, the agents are going to be writing a hundred percent of your code, reviewing a hundred percent of your code, shipping a hundred percent of your code. Like, that's where we're going.”
Carson: Ralph AI loop functions as an entire engineering team overnight
“This loop is basically an entire engineering team while you sleep. It's unbelievable. And this just wasn't possible for Opus four or five. I think with Opus four or five, this is absolutely The real deal.”
Carson: AI engineering token costs will hit $5,000 monthly per employee
“I think all of us are in a place where we, we're getting to the spot where it's realizing, okay, for real engineering work per employee, you're looking at probably five grand a month. Like, that's probably where we're gonna shake out here.”