Scott Wu, CEO of Cognition, describes the productivity gains reported by engineering teams deploying Devin.
Prediction Not checkable as stated
Scott Wu predicts humans will soon stop interacting directly with code
“We're not always, I mean, we're not gonna be interacting with code for that much longer, you know, or programs might not be the right, like level of abstraction, but I think what is always true probably is that it will be the human computer interface.”
Prediction Not checkable as stated
Scott Wu predicts intent-to-execution AI development will be solved in five years
“But I honestly, I mean, I think we'll have solved most of that over the next five years or so.”
Prediction Open · timeframe Jun 2031
Scott Wu predicts AI systems will eventually work unassisted for a year
“And yeah, I think that's true, and I think we will get there.”
Assertion Not checkable as stated
Scott Wu confirms initial Devin launch videos were real, unstaged runs
“All of those like demos that we showed, you know, in, in, in our launch announcement were like actual runs of Devon that we had done ourselves and like run into and been like, holy shit, this is insane.”
Assertion Not checkable as stated
Scott Wu admits AI agents did not work generally during early deployments
“Let's be real here, ok? Agents did not work generally, ok? And so, there was a lot of like, how do you make it work for you very specific?”
Assertion Supported
Devin scored 13 percent on SWE-bench against a 3 percent baseline
“At the time the best known was like Three or four percent or something like that, but obviously, yeah, 13% still means you fail, you know, 87% of the time.”