Assertion Not checkable as stated
Scott Wu: Agent-forward engineers see 5x to 10x productivity gains
“I think right now, you know, you have this core group of, we'll call it like agent forward engineers, right? Or agent forward companies that understand how to use this and they are seeing these, you know, five X, 10 X productivity games as a result.”
Insight
Scott Wu: Testing candidates on tasks AI can do is the wrong interview strategy
“And I think if you're asking the question of like, how do we evaluate people on exactly the thing that AI can already do, that's kind of the wrong way.”
Insight
Wu: Technical execution matters more in AI than in past tech waves
“I think in AI, what you see is that really excelling on the technical aspect just matters much more, I think, in AI than some of these other fields, and I think there's been lots and lots of businesses in the past that have been very, I'll say, like very inten…”
Disclosure
Scott Wu: Cognition engineers no longer type code
“For us at Cognition, for example, our engineers don't type code anymore.”
Insight
Wu: AI agents enable software engineers to focus 10x more on architecture
“10% of that job is basically this really fun part of just pure problem solving, thinking about what you want to build, being creative, like understanding the different solutions, deciding, okay, what architecture makes sense here? How exactly am I going to, yo…”
Assertion Partly supported
Wu: AI autonomous work capacity doubles 4-5 times per year
“And I think for the last few years, it's doubled about four or five times every year, you know, which is insane, which means, you know, you wait two or three months and it's already doing twice as much work.”
Prediction Not checkable as stated
Wu: Reinforcement learning will eventually beat any benchmark with a clear feedback loop
“I think the natural conclusion of RL, which is what we're kind of getting to, is you basically can solve any benchmark, which is insane to think about... Which means like, if you have a clean set of environments, if you have a good feedback loop to decide what…”
Assertion Not checkable as stated
Wu: Devin routinely delivers 6x to 20x efficiency gains for enterprise customers
“We pretty routinely see spots where we can make things like anywhere from six X to 20 X more efficient.”
Prediction Not checkable as stated
Wu: Within five years, software engineering will just be describing what to build
“And I think that's kind of what we're going to get to over the next, I'll call it like five or so years is a point where Software engineering. We might even still call it software engineering or programming or whatever, but it's, it really is just you telling …”
Opinion
Wu: Students should still study computer science despite AI coding advances
“People ask me all the time, you know, it's my son or daughter is, 16, you know, should they even be studying computer science? And I always say, yeah, absolutely. And I think the reason is because these are, you know, the concept level things that actually all…”
Prediction Not checkable as stated
Wu: Lowering barrier to coding will drastically increase total software built
“And I think we're going to see something similar here where it's, you know, imagine, imagine the w w w what we will do, you know, when we get to the point where everyone can just build products and websites and apps and whatever it is of that level of quality …”
Assertion Not checkable as stated
Wu: The duration of autonomous AI coding tasks doubles every three months
“And the crazy thing is over the last like three, four years, that number has basically, it's doubled approximately every three months.”
Insight
Wu: Raw intelligence is no longer the bottleneck in AI
“I think what it kind of shows, I would say is actually, I think we're at a point now where intelligence actually isn't the bottleneck, if that makes sense. You know, I think these models are capable of solving some really, really hard problems.”
Assertion Partly supported
Scott Wu: AI autonomous work time doubles four to five times yearly
“And the thing that's really crazy about this stat is, you just see it very consistently double. And I think for the last few years, it's doubled about four or five times every year, you know, which is insane, which means, you know, you wait two or three months…”
Assertion Supported
Wu: AI autonomous task duration grew from 10 seconds to 18 hours
“One of the stats that people talk about a lot is this METR report, which basically says for each different model that comes out roughly how much human work can it do in an automated fashion before you have to go interrupt it and say, oh, that was wrong. Let's …”
Opinion
Scott Wu: Citrini's AI thesis gets basic economics wrong
“You know, so, so funnily enough, I think recently we had this whole Cetrini piece come out which I thought was frankly ridiculous. I mean, I think it's, I think it gets a lot of the basic economics wrong is maybe a simple way to put it.”
Insight
Wu: AI coding advances faster because executable code provides immediate verifiable feedback
“One of the reasons that code is growing so quickly is because you have this really great feedback loop of success or failure, right? It's, you know, in, in, in healthcare or in law or something like that, you know, it's a lot harder to say, you know, whether y…”
Prediction Not checkable as stated
Scott Wu: AI coding will shift toward proactive, event-driven autonomous work
“So you're gonna see a lot more, I think, proactive work. You're gonna see a lot more basically like event-driven kickoff work where it's, it doesn't have to be human that's moderating it every step of the way.”
Assertion Supported
Wu: One 20-person USACO camp produced Wang, Guo, Ziegler, and Ho
“In my year, actually there were a ton of others who all kind of went into AI. And so obviously Steven and Andrew, who started the company you know, who started Cognition with us but also a ton of others. And so Alexander Wang, who started Scale. Demi Guo, who …”
Disclosure
Wu: Cognition acquired Windsurf and shares engineers across both products
“We bought Windsurf, you know, seven, eight months ago at this point, but like, we don't have a distinction of like, oh, this person's an engineer working on Devon or this person's engineer working on Windsurf. Like a lot of the same people should be people who…”
Assertion Not checkable as stated
Wu: Cognition's early 2026 Devin usage surpassed all of 2025
“Today's March ninth, and we actually, at this point, have already done more Devon sessions in our customers in 2026 than we had in 2025. And so basically over the last like two months and change, we've already done more Devon usage in total than we had in all …”
Disclosure
Wu: Cognition lets engineering candidates use unlimited AI during interviews
“For us, and this has always been the case for us, you know, our interview process has always been, you can use as much AI as you want to use. You know, it's just like, we're going to give you a few hours, just build, build your whole own product surface, right…”
Insight
Wu: AI coding agents need full environment access, not just text interfaces
“We had the view that instead of pure text interfaces, there was going to be A lot more full interaction where, you know, AI systems could not just read texts and answer questions, but actually just go and interact with the real world and encode. Obviously that…”
Opinion
Scott Wu: Career success is only possible because of advanced math classes
“I mean, I think the, like, I, I'm only here because of advanced math classes is kind of what I would say”
Scott Wu