why aren't all 17 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Prediction Not checkable as stated
Scott Wu predicts humans will soon stop interacting directly with code
“We're not always, I mean, we're not gonna be interacting with code for that much longer, you know, or programs might not be the right, like level of abstraction, but I think what is always true probably is that it will be the human computer interface.”
Assertion Not checkable as stated
Scott Wu confirms initial Devin launch videos were real, unstaged runs
“All of those like demos that we showed, you know, in, in, in our launch announcement were like actual runs of Devon that we had done ourselves and like run into and been like, holy shit, this is insane.”
Assertion Not checkable as stated
Scott Wu admits AI agents did not work generally during early deployments
“Let's be real here, ok? Agents did not work generally, ok? And so, there was a lot of like, how do you make it work for you very specific?”
Assertion Not checkable as stated
Engineering teams using Devin ship software ten times faster
“And in practice, what it looks like is that teams use Devon to ship 10 times faster and to do 10 times more.”
Assertion Supported
Devin scored 13 percent on SWE-bench against a 3 percent baseline
“At the time the best known was like Three or four percent or something like that, but obviously, yeah, 13% still means you fail, you know, 87% of the time.”
Opinion
Staniszewski: Cognition can become one of the future hyper AI companies
“Well, Scott, I think they should build independent company too. I think they have an opportunity to be one of the hyper AIs of the future or however you call the hyper clouds of the future.”
Disclosure
Devin dynamically routes tasks across OpenAI, Anthropic, Google, and internal models
“Devin, rather than being pegged to one model and saying, oh, we're only going to serve you GPT for this, or we're only going to serve you OPFIS for this, Devin can use any of the different models it has in its arsenal, which include all of these models from An…”
Insight
Scott Wu compares building a company to a tree search algorithm
“It's the way even building a company, it feels the same. It's just like you're calculating the moves. You're thinking about, okay, if you do this and then this happens and then you do that and here are the different moves and you're like calculating out what c…”
Disclosure
Cognition ignores individual hobbyists to focus on production engineering teams
“And so, so we don't focus at all on like, you know, individual hobbyists who are just like trying to make a cool thing or something like that. We focus on like, Real teams who are building real products that they want people to use and getting output out of th…”
Disclosure
Cognition's entire team flew to Brazil to onboard its first enterprise customer
“Well, so NewBank, I mean, the first one, honestly, our entire team was the Ford deployed team. Like we all flew to Brazil.”
Assertion Not checkable as stated
Cognition generates 75 to 80 percent of revenue from enterprise customers
“Today, around 75, 80%.”
Disclosure
Cognition works with Goldman Sachs, Mercedes, and the US government
“We work with a lot of the big, biggest companies across the world, you know, we work with Goldman Sachs, we work with Mercedes, we work with, you know, a lot of areas of the U S government at this point and so on.”
Assertion Supported
Cognition's first commercial success was an enterprise migration for Nubank
“Our first success ended up being with a company called Nubank, biggest bank in Brazil, you know, by market cap at the time, and the use case was like one of these big migrations, and we had a kind of a custom Devon that was like extremely, extremely optimized …”
Assertion Not checkable as stated
The first automated task Devin successfully performed was setting up MongoDB
“The first task that Devon did was it like set up MongoDB for us.”
Disclosure
Cognition aims to complete enterprise customer deployments in three months
“We're saying that these cycles typically take 12 to 18 months. We try to get deployed with folks, you know, in like three months.”
Assertion Partly supported
Cognition started with an unusually large founding team of nine people
“Our founding team is, it was a pretty big founding team. It was nine people. And most of us had already founded our own companies before we had done different things.”
Disclosure
Scott Wu's childhood home displayed math trophies instead of family photos
“We didn't have like, you know, growing up, like we didn't have like pictures of our parents, like on the walls. You know, we just had old math competition trophies.”