The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 34 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 1 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Yan: Practical multi-agent setups require isolated sandboxes without shared machines
“We've actually given Devon an MCP so they can just go arbitrarily message other Devons and create new Devons, et cetera. But I guess like it somehow creates like a really chaotic world in that sense. And so we, we've still found that most practical use on a da…”
Wu: Autonomous coding agent capability currently doubles every 70 days
“What you see in general is that that doubling time is about every seven months, which already is pretty crazy, actually, but in code, it's actually even faster. It's every 70 days, which is two or three months, and so, you know, if you look at various software…”
Wu predicts AI coding agents will advance 16x to 64x in 12 months
“And I think that, you know, we're gonna see another 16 to 64 X over the next 12 months as well.”
Jesse Hu: SWE-bench gains over baseline GPT-4 come entirely from agent scaffolding
“The diff between that and something like Devin is all in like, sort of like the agent scaffold or the agent code, right? So that's, what's really exciting about this stuff. It shows off what you can do just from prompting and just from adding tools.”
Shawn Wang says Devin's breakthrough was Agent-Computer Interfaces, not advanced planning
“The planner is like actually pretty simple, but ACI. That they book through on.”
Yan: Cognition merged PRs grew 7x as headcount grew only 10%
“It grew like seven X over like the last, I think it was like two months, three months, something like that. And then you see our engineering headcount growth, it's like gone up by like 10% or something.”
Yan: Devin requires orchestrating multiple frontier models for end-to-end app testing
“Well, in some cases we found that actually no one frontier model can actually do this full end-to-end task itself. We've seen cases where we actually had had to orchestrate different frontier models together to kind of solve this problem together.”
Yan: Cognition stripped obsolete Devin code after Sonnet 3.7 release
“So it's almost funny to be talking about how like big of a leaps on it. 3.7 was, and we honestly, a lot of it was stripping out parts of Devon that were no longer needed with that jumping of intelligence.”
HackerRank evaluates candidates on reviewing AI-generated PRs, not prompt engineering
“The way we test for the usage of agent stuff is less about, can you prompt the agent to do the work, but more in terms of, hey, I've actually generated a bunch of PRs from Devin or Cloud Code or Gemini or like Codex or whatever. Can you go ahead and like revie…”
Wu: Devin built many of Cognition's API integrations and internal dashboards
“A lot of the API integrations that Devin has were built by Devin. You know, a lot of our own internal dashboards and metrics tracking within Devin were actually also built by Devin.”
Swix: Devin's hourly billing model incentivizes slow execution
“And it's perverse in senses where they charge by hour. So they make more money, the slower they are.”
AI agent moats lie in business interfaces, where Devin leads significantly
“I think that may be where most of the, like, if there's any mode here, it's gonna be around, like, the interfaces into humans and their businesses. And Devon, like, has a major, major lead on, on making that work really well.”
WorldSim can simulate dev teams, making AI engineers like Devin unnecessary
“I can also generate a dev team and ask it to do stuff with me, and you don't need devin.”
Yan: Local agents should defer decisions; cloud agents must test autonomously
“So the funny thing here is that the behavior between local agents and cloud agents, I think that is actually a bit different in their ideal state. I think local agents, you want them to be a bit more fast and let the user make the call on things. Actually don'…”
Yan: Agent assertiveness and pushback enables true multi-agent systems
“But I think the thing that gives me the most bullishness that multi-agents might actually be possible is actually what I said earlier about Devon will actually sometimes tell me I'm wrong. And push back. And I think that demonstrates a level of maturity and co…”
Yan: Roughly 95% of Devin's memories are auto-generated
“I find that, like, 95%, I think some crazy stuff like that of the memories that Devin has are all through these auto-generated things. Like, very few people actually just want to sit down and write big docs on, okay, here's how you're supposed to work with the…”
Colvin: Pydantic team uses Devin after finding it best off-the-shelf coding agent
“We, so in Pylandsk AI, the guys are using Devon quite a lot. And actually we tried quite a few, nothing else worked, but Devon, well, not nothing else worked, but like having gone through a few different options, Devon seemed to be the best of the off the shel…”
Building a custom IDE would cost AI coding startups $100M
“If like Cursor or Devon would have to build their own VS code, that'd cost a hundred million dollars, you know? Call me back in five years.”
Wagner says Devin's 'Ask' function is its most underrated feature
“Now we use Devon here religiously, and I think one of the most underrated features of Devon is the actual ask feature.”
HackerRank lets non-engineers assign low-priority tasks directly to AI agents
“Even internally, we're getting to, in our company, we're getting to a point of, it's not just like developers, but solution engineers, support people, being able to tag something like a dev in to say like, hey, there's a typo in this added message, go, go fix …”
Wu: Cognition has no plans to change Devin and Windsurf product philosophies
“What I would say at a high level is, look, I think spiritually, you know, we really want to maintain the philosophies of both of these products and we have no plans to change that.”
Scott Wu: Software engineering is investigative work suited to autonomous agents
“There's so much more to being a software engineer than typing the code, right? A lot of the work that you're going to do is, you know, you're going to be looking into a bug, You're going to be looking at the different files of the code base. Maybe you're going…”
Yan: Cognition built Blockdiff to speed up Devin VM state restoration
“The blockdiff file storage format, which is a file system format that we built so that the VMs could be spun up and down very quickly. Basically, the intuition behind this is imagine you have like a terabyte of disk And your agent only like wrote like a hundre…”
Yan: Cognition offers in-VPC deployment for Devin across customer clouds
“Now, one thing we offer when we go and Sell Devon to people is, you know, you don't have to worry about all the compute side of things. We'll make it work. We'll make it work in your cloud if you wanted to.”
Yan: Cognition built Devin to separate brain control from machine execution
“I think a lot of that, what you mentioned is why we actually from the start built Devon to what we called separate the brain from the machine.”
Yan: Early Devin state restorations on cloud VMs took 10 minutes
“When we just built it off of raw VMs from cloud providers like EC two, the boot up time Was so slow. I think and especially the, then like turning off the machines, saving them, and then to be able to bring them back up again when the, when you want Devon to w…”
Yang: SWE-bench adoption took off only after Cognition's Devin launch
“You know, we put it out October, 22, 23, and then people didn't really touch it too much. And then, of course, like, Cognition came on the scene, and Devon was an amazing release, and I think after that, it kind of kicked off the arms.”
Wagner admits Flux's knowledge-base architecture was inspired by Cognition's Devin
“We love Devin here. Yeah, I mean, I know a lot here is inspired by Devon, like the knowledge-based thing, right, is inspired by Devon, right?”
Martin: Cognition's Devin uses a fine-tuned model for context summarization
“Devin uses a fine-tuned model for doing summarization within the context of coding.”
Wang: Prior to merger, Devin was building an IDE and Windsurf an agent
“We actually looked at each other's roadmaps, like product roadmaps and the Devon team was actually looking to build an ID and our team was actually looking to build a remote agent.”
Alberti: Devin updates codebase indexes on every commit for paid users
“If you like pay for Devin, for example, like we actually update it on literally every commit incrementally.”