Cognition CEO Scott Wu discusses with Stripe CEO Patrick Collison why AI economic infrastructure must transition from per-seat SaaS models to usage-based billing.
Opinion
Wu: Devin performs on average like a junior engineer
“We like to call Devon a junior engineer today. There are some things that an AI, of course, is way, way better than all of us at, you know, especially encyclopedic knowledge and just pulling facts and things like that. There are some things that it's, you know…”
Assertion Not checkable as stated
Wu: Enterprises measure 8x to 15x productivity gains using Devin for migrations
“I think in practice what we see with folks, especially in these kind of like enterprise migrations is, is, you know, when folks measure internally, they see something like an eight to 15 X gain for a lot of these use cases with Devon because, Yeah, as you're s…”
Insight
Wu: General AI intelligence alone will not solve messy software engineering
“Software engineering in the real world is so messy, you know, and there's all sorts of these things that come up. And I think in practice, you know, most disciplines look like this. And I would say the same thing about law or medicine or, and so on. And so whi…”
Insight
Wu: Solved AI benchmarks shift bottleneck to defining real-world benchmarks
“The thing is when that happens, I don't think what we end up with is just pure ASI end of humanity, human knowledge work or whatever. I think the thing that we end up in is basically a point where the hard question is, all right, now what is the benchmark, rig…”
Prediction Not checkable as stated
Wu: Language syntax will matter less than product sense in software engineering
“Yeah, I think what we find is, is, and I think this, you know, we'll see this trend generally in software engineering, which is knowing all the little, memorizing all the facts or knowing all the little details or being really good at Syntax of some language o…”
Prediction Open · timeframe Aug 2029
Wu: Developers will stop using code as primary interface in 2-4 years
“I think that there will come a point, and my guess on this point is probably in the neighborhood of, let's say, two, three, four years from now, where we stop using code as the main interface.”