The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 30 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Carson: Engineers coding locally are cavemen shipping 10x less code
“So I think if you are working locally, I honestly think you are a caveman. Like, I think you're, you are holding yourself back, and you are shipping 10 X less than you could be, and it is not smart. No matter if you think the cool people work locally and all t…”
Carson: The AI agent era requires working more, not less
“And in in order to survive in this new world, you're going to work a lot more, not a lot less.”
Carson warns against building workflows on frontier models to avoid lock-in
“Like, if you are, if your whole engineering you know, motion is happening inside of clock code or inside of codex, What are you doing? Like, because they are not incentivized to make it reasonable for you long term, right? They're going to lock you into their …”
Carson: AI agents will write, review, and ship 100% of code
“You will be using a software factory. Like, and what I mean is, the agents are going to be writing a hundred percent of your code, reviewing a hundred percent of your code, shipping a hundred percent of your code. Like, that's where we're going.”
Carson: Ralph AI loop functions as an entire engineering team overnight
“This loop is basically an entire engineering team while you sleep. It's unbelievable. And this just wasn't possible for Opus four or five. I think with Opus four or five, this is absolutely The real deal.”
Carson: AI engineering token costs will hit $5,000 monthly per employee
“I think all of us are in a place where we, we're getting to the spot where it's realizing, okay, for real engineering work per employee, you're looking at probably five grand a month. Like, that's probably where we're gonna shake out here.”
Carson: Knowledge workers across all roles are becoming AI agent managers
“Essentially you are a manager of agents now.
So no matter what you used to do, whether it was a people manager, an IC, you are going to become a manager of agents now, and you need to be the best in the world.”
Carson: Managing AI agents makes developers more technical, not less
“The more you become a better agent manager actually the more technical you become.”
Carson averages 22 to 25 pull requests daily using AI agents
“And you can see what, you know, the average here is, is sort of this 22 to 25 PRs a day, right? And sometimes, you know, 40 a day.”
Carson ships three PRs daily from an autonomous AI grading loop
“Every day I have an automation that looks at these chats and then grades them on a rubric. And so you, and again, just talk to your agent about this. You pick the most important part of your app that you want to self-improve and say, here's how you agent judge…”
Carson spent $20,000 on AI tokens in a single month
“So last month I spent probably 20 grand in, in tokens. Which is just too much. Like, it's not viable.”
Ryan Carson: Non-technical users with agency can build software with AI agents
“I think you need to be curious. I think you need to have agency. But I think if you have those two things, which you probably do, if you're watching the show you can do this now. It helps to be technical, right? There's a couple of things that are useful, but …”
Carson does over half of his startup work on his phone
“You know, I do almost 50%, probably more of my work from my phone.”
Carson: Never give AI agents direct production write keys
“It's very important to keep your keys safe, secure, and separated from the agent, right? So I've got all my prod write keys in one password. I do not give my agents a prod write keys. So production writing is dangerous, right? And your agents will do something…”
Carson: Devin is one of the best software factories in tech
“I think it's one of the best software factories in the industry. It's not cheap. But it's good.”
Carson: AI Agents Are Really Good at Writing PRDs
“So you start off with writing a PRD and a PRD thankfully is something that agents are really good at.”
Carson: Autonomous agent tasks must fit within a single context window
“So this is the other big unlock with working with agents is that they have a context limit, right? So you know, with Opus, you're looking at about 168,000 tokens. You have to be picking chunks of work that can be fully completed within that context window.”
Ryan Carson Built an Entire Software Feature Autonomously Using Ralph
“I actually built an entire feature with Ralph, and these are the steps I took. I created the PRD, I created the user stories, and then I started Ralph, and then I'm just going to show you an example of kind of what this looks like for real.”
Carson: Autonomous agents won't derail if constrained by atomic user stories
“People are afraid of like, what if the agent runs by itself? Is it going to go off and do crazy things? And the answer is no, because you gave it a clear user story with clear acceptance criteria, right? It's going to be actually a pretty small thread.”
Carson: AI agents should compound intelligence from mistakes via markdown memory files
“Your agent should be getting smarter every time it makes a mistake. And by updating agents.md, you are going to get that long-term benefit. This isn't just during this iteration. You're going to benefit every time from now on that you use amp or clog code.”
Carson: Ralph loop isolates context by spawning fresh agent threads
“And what's happening is you're getting a fresh loop every time. So you're getting a brand new thread or a brand new instance of cloud code every time. So you're starting fresh with a brand new context window starting from fresh.”
Carson: Autonomous AI Agents Require Atomic User Stories and Clear PRDs
“These two steps, writing a PRD and converting them to user stories, this is where you should spend a huge amount of time. Like you should spend an hour on this, right? It's very, very, very important that you get your PRD right, and that your user stories are …”
Carson runs up to ten cloud coding agents simultaneously without collisions
“So I often have, you know, at least five cloud agents working at once, often 10, and there's no risk that the code is going to collide.”
Carson spends $60 per run for automated Devin browser tests
“And I have a it's called end-to-end sign-up test, and that runs three times a week because it is expensive. It's probably 60 bucks in tokens because it's doing a lot of, it's doing a lot of browser testing”
Carson: Autonomous coding agents require built-in automated feedback mechanisms
“This is one of the big unlocks with Ralph or any kind of flow like this is that the agent needs to have a feedback mechanism so that it knows if what it's doing is correct.”
Carson: Ralph agent codebase is open-source and publicly downloadable
“And again, this is all open source and we're going to have all these notes all these links in the notes. And so you could literally take this Ralph public repo I have, download it, and use it.”
Carson: Typical Ralph AI agent cycle takes 10 iterations and costs $30
“The typical Ralph cycle is probably 10 iterations. So you're looking at maybe 30 bucks.”
Carson: Coding Agents Need Dedicated Tools to Test Browser Front-Ends
“Dev browser use this because what this does is this allows AMP or cloud code to actually use your browser and test, and your user stories that involve front-end code remember that the agent needs to be able to test that, and testing browser is hard for agents,…”