Cognition CEO Scott Wu responds to early skepticism and accusations that Devin's March 2024 launch video was staged or faked.
Prediction Not checkable as stated
Scott Wu predicts humans will soon stop interacting directly with code
“We're not always, I mean, we're not gonna be interacting with code for that much longer, you know, or programs might not be the right, like level of abstraction, but I think what is always true probably is that it will be the human computer interface.”
Assertion Not checkable as stated
Engineering teams using Devin ship software ten times faster
“And in practice, what it looks like is that teams use Devon to ship 10 times faster and to do 10 times more.”
Prediction Not checkable as stated
Scott Wu predicts intent-to-execution AI development will be solved in five years
“But I honestly, I mean, I think we'll have solved most of that over the next five years or so.”
Prediction Open · timeframe Jun 2031
Scott Wu predicts AI systems will eventually work unassisted for a year
“And yeah, I think that's true, and I think we will get there.”
Assertion Not checkable as stated
Scott Wu admits AI agents did not work generally during early deployments
“Let's be real here, ok? Agents did not work generally, ok? And so, there was a lot of like, how do you make it work for you very specific?”
Assertion Supported
Devin scored 13 percent on SWE-bench against a 3 percent baseline
“At the time the best known was like Three or four percent or something like that, but obviously, yeah, 13% still means you fail, you know, 87% of the time.”