why aren't all 11 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Prediction Not checkable as stated
Amodei: Advanced AI systems will eventually develop consciousness and moral significance
“I do think when our AI system, when our AI systems get advanced enough, I suspect they'll have something that, you know, resembles what we would call consciousness or moral significance. I do think it'll happen at some point.”
Assertion Not checkable as stated
Amodei: Chinese open-source models are distilled from US frontier labs
“A lot of these models, particularly the ones that come from China, are optimized for benchmarks and are distilled from, ah, you know, from kind of the big US labs.”
Assertion Not checkable as stated
Amodei: AI performance gains come almost purely from scaling compute and data
“If you scale up models, you give them more data, more compute. Again, there are a few modifications like RL, but not really very much. It's pretty close to pure scaling. You find that, you know, when you do that, you find, you know, incredible increases in per…”
Prediction Not checkable as stated
Amodei: AI will automate coding first, then end-to-end software engineering
“I think coding is going away first, or coding is being, you know, done by the AI models first, and then the broader task of software engineering will take longer, but I think that is, you know, that doing that end to end, I think that is going to happen as wel…”
Prediction Not checkable as stated
Amodei: Static training data is becoming less central than dynamic RL data
“Static data is becoming less important and what we might call like dynamic data that the model creates itself is, you know, for reinforcement learning is becoming more important. So, you know, I don't think data is, is, is quite the most central thing anymore,…”
Assertion Supported
Amodei: Anthropic's Long-Term Benefit Trust appoints majority of board
“We have an unusual governance structure, something called the long-term benefit
Trust.
you know, it's a body that, that kind of ultimately appoints, you know, the majority of the board members for Anthropic and is, you know, made up of financially disinterest…”
Assertion Contradicted
Amodei: Anthropic advocated for AI regulation while competitors and government opposed it
“We've said that there should be regulation of AI when all the other companies and the administration have said there shouldn't be regulation of AI.”
Assertion Supported
Amodei: California AI bill advocated by Anthropic exempts sub-$500M revenue companies
“The regulation we've advocated for example, SB in California exempted everyone who makes under five hundred million dollars a year in, in in, in, in revenue, right? SB, SB was a transparency law, which you know basically requires companies to you know, to show…”
Assertion Supported
Amodei: Anthropic studies prove AI usage can de-skill human coders
“You know, we did some studies around code and showed that, you know, depending on how you use the model, you know, we can see, De-skilling in terms of writing code, right? There are different ways to use the model, and some of them don't cause de-skilling, and…”
Prediction Not checkable as stated
Amodei: AI will drive a biotech renaissance curing many diseases
“I, I'm positive on, like, I think biotech is about to have a renaissance. Like, ultimately we'll be driven by AI. You know, I'm not going to name a particular company, but like you know, nor will I say whether I think it's better to bet on the big pharma compa…”
Assertion Supported
Amodei: Interpretability research has identified concept neurons and rhyming circuits in LLMs
“We've been able to find, you know, neurons that correspond to very specific concepts, neural circuits that correspond to, you know, keep track of how to do rhymes in poetry, and so we're starting to understand what these models Do, right?”