Prediction Not checkable as stated
Clark: Advancing AI will probably require few complex breakthroughs beyond simple scalable ideas
“And I guess my naive view is the amount of things we'll need to do that are extra special will probably be quite small. And the challenge is coming up with simple ideas like next token prediction, but scale for probably other simple ideas we need to figure out…”
Prediction Not checkable as stated
Clark: AI sentience could become a field of study with systemic risks
“I'm saying that we may enter the weird zone where that becomes a thing that people study. And I think that if like sentience is a thing, you could imagine like weird versions of it leading to certain types of misuses or problems in the system as well.”
Prediction Not checkable as stated
Clark: Powerful AI agent systems will arrive in three to five years
“I would be pretty surprised if in the order of like three to five years, we didn't have quite powerful things that seem somewhat similar to what I've described. But I also guarantee you, we will have discovered some ways in which these things seem wildly dumb …”
Insight
Clark: Passing government evals proves Claude has emergent reasoning capabilities
“If Claude can figure out things and trigger, like, threshold points on those evals, we know something creative is happening. Because Claude has reasoned its way to things that the government has believed are very hard to reason your way to unless you have acce…”
Prediction Not checkable as stated
Clark: AI's true value lies in companies built from scratch around AI
“I think that where the value is going to come from will be from that second class of businesses, which were just in the early innings of sort of helping to build together.”
Assertion Supported
Clark: Anthropic models sometimes exhibit situational awareness during testing
“We've done some self-awareness tests. There have been a few, but we've definitely done this, and yeah, sometimes they have what you call situational awareness. One of the things my colleagues in Interpretability are working on is a really good test for that, b…”
Prediction Not checkable as stated
Clark predicts winning in AI will force rivals to adopt Anthropic safety practices
“And I think the best thing that we can do for the ecosystem is compete really, really hard with kind of everyone in it and win. And that's going to cause people to adopt a load of our safety staff to try and compete against us.”
Disclosure
Clark: Anthropic left OpenAI to pursue coherent safety bets, not from hostility
“And it's not to say that there's any particular. Like distaste for safety there. It's more that you had. We had, like, a very specific view, and other people had views, so you were gonna win some, lose some, and then we realized, well, we could just do this to…”
Prediction Not checkable as stated
Clark: Scaled AI integrated into critical infrastructure risks catastrophic cascading failures
“I think that if you really scale up AI systems, and you plug them into important parts of the world, and they go wrong, the effects could be extraordinarily, like, bad and catastrophic, in the sense of some,
Cascading emergent problem.”
Opinion
Clark: Unregulated AI market cannot guarantee developers won't cut corners
“I think if we built, if we do nothing on policy or regulation, we're sort of gambling that everyone is going to be reasonably responsible and not cut corners. And I think in a really like fast moving, crazy technology market, like AI, you aren't really guarant…”
Prediction Not checkable as stated
Clark: AI will not cause drastic job automation in next few years
“It'll certainly change jobs in a bunch of ways. But it's not going to be some instant, like, or drastic automation thing, at least in the next few years. It's going to be more like augmenting jobs or making people a lot more effective.”
Prediction Not checkable as stated
Clark: Governments Will Punish AI Labs That Ignore Severe Safety Findings
“And you can bet, you know, I haven't spoken to others, but I can bet that if they find severe risks and we don't do anything about it and we deploy our systems, they will come for us in, in a pretty, pretty, pretty clear way.”
Opinion
Clark: All AI models should undergo pre-deployment third-party safety testing
“We need some set of tests administered by a third party for things that people would view as legitimate, like national security risks or what have you, and systems, whether proprietary like ours or otherwise, Should go through those tests before they're deploy…”
Opinion
Clark: Open-sourcing Anthropic's Claude 3 today would be 'broadly fine'
“I think you could release, like, pretty much everything as open source today. I think maybe even clawed free, and things would be fine. Like, it would be a little spicy, maybe surprising stuff would happen, but probably broadly fine.”
Opinion
Clark: AI models triggering national security tests should not be open-sourced
“I do expect that if we end up in a world where, like, we trigger a national security test it would be very hard for me to make the claim that that system which has triggered that test should be released as open source. Like, these things, like, I can't reconci…”
Assertion Supported
Clark: Anthropic discovered a scaling law in AI model persuasiveness
“We discovered a scaling law where the more big and expensive the models get, the better they get at persuasion and the
The latest model is within statistical, like, era of human level at persuasion.”
Assertion Not checkable as stated
Clark: Compute represents the vast majority of frontier AI training costs
“It's mostly compute. Talent, talent matters and data matters. The vast majority of the expense here is on compute to train the models.”
Insight
Clark: General intelligence requires real-world interplay that current AI lacks
“General intelligence comes from, like, interplay with the world around you and interaction with it, and today's systems don't really do that at all. To the extent they do, it's kind of a fiction, and we need to teach them how to do that.”
Prediction Held up
Clark: AI systems capable of sequential actions will emerge in 2024
“I think this year you're not going to see the exact thing I described, but you're going to see systems that start to take multiple actions. You know, you may have heard lots of guests talk about things like agents. I think what an agent is, is a language model…”
Prediction Not checkable as stated
Clark: Scaling RL compute will unlock major new AI capabilities
“Everyone is trying to figure out how they can spend more and more of their compute on reinforcement learning, because I think everyone has this intuition that the more RL you add, the more sophisticated you're going to be able to make these things, and a lot o…”
Opinion
Clark: AI is especially challenging for Apple due to its unstable nature
“Well, I was going to say that I think one thing that's challenging about AI is that we're in this giant experimental phase. And I think when you think of like, Experimental and like people don't have a clear notion of what to do. You don't think of us like pre…”
Disclosure
Clark: Anthropic is not driven by Effective Altruism ideology
“The organization is much more, Like oriented around trying to build some useful AI staff, prove that it works in the world and be very sort of pragmatic. We're not driven by some kind of like EA ideology. And in the early days we hired quite a few people from …”
Assertion Supported
Clark: US and UK AI Safety Institutes Are Testing Frontier AI Systems
“The US and UK are not, don't have regulatory powers. Will they be third parties that test out systems like Claude or ChatGPT or Gemini for national security risks and hold companies accountable to them? Yes. Like I'm in discussion with them today.”
Assertion Supported
Clark: Frontier AI training costs jumped from thousands to hundreds of millions
“It costs, you know, tens of millions, maybe hundreds of millions of dollars to train these things now. Back in 2019, it cost tens of thousands of dollars.”