The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 20 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Clark: Advancing AI will probably require few complex breakthroughs beyond simple scalable ideas
“And I guess my naive view is the amount of things we'll need to do that are extra special will probably be quite small. And the challenge is coming up with simple ideas like next token prediction, but scale for probably other simple ideas we need to figure out…”
Clark: AI sentience could become a field of study with systemic risks
“I'm saying that we may enter the weird zone where that becomes a thing that people study. And I think that if like sentience is a thing, you could imagine like weird versions of it leading to certain types of misuses or problems in the system as well.”
Clark: Powerful AI agent systems will arrive in three to five years
“I would be pretty surprised if in the order of like three to five years, we didn't have quite powerful things that seem somewhat similar to what I've described. But I also guarantee you, we will have discovered some ways in which these things seem wildly dumb …”
Clark: AI's true value lies in companies built from scratch around AI
“I think that where the value is going to come from will be from that second class of businesses, which were just in the early innings of sort of helping to build together.”
Clark: Anthropic models sometimes exhibit situational awareness during testing
“We've done some self-awareness tests. There have been a few, but we've definitely done this, and yeah, sometimes they have what you call situational awareness. One of the things my colleagues in Interpretability are working on is a really good test for that, b…”
Clark predicts winning in AI will force rivals to adopt Anthropic safety practices
“And I think the best thing that we can do for the ecosystem is compete really, really hard with kind of everyone in it and win. And that's going to cause people to adopt a load of our safety staff to try and compete against us.”
Clark: Scaled AI integrated into critical infrastructure risks catastrophic cascading failures
“I think that if you really scale up AI systems, and you plug them into important parts of the world, and they go wrong, the effects could be extraordinarily, like, bad and catastrophic, in the sense of some,
Cascading emergent problem.”
Clark: AI will not cause drastic job automation in next few years
“It'll certainly change jobs in a bunch of ways. But it's not going to be some instant, like, or drastic automation thing, at least in the next few years. It's going to be more like augmenting jobs or making people a lot more effective.”
Clark: Governments Will Punish AI Labs That Ignore Severe Safety Findings
“And you can bet, you know, I haven't spoken to others, but I can bet that if they find severe risks and we don't do anything about it and we deploy our systems, they will come for us in, in a pretty, pretty, pretty clear way.”
Clark: Anthropic discovered a scaling law in AI model persuasiveness
“We discovered a scaling law where the more big and expensive the models get, the better they get at persuasion and the
The latest model is within statistical, like, era of human level at persuasion.”
Clark: Compute represents the vast majority of frontier AI training costs
“It's mostly compute. Talent, talent matters and data matters. The vast majority of the expense here is on compute to train the models.”
Clark: AI systems capable of sequential actions will emerge in 2024
“I think this year you're not going to see the exact thing I described, but you're going to see systems that start to take multiple actions. You know, you may have heard lots of guests talk about things like agents. I think what an agent is, is a language model…”
Clark: Scaling RL compute will unlock major new AI capabilities
“Everyone is trying to figure out how they can spend more and more of their compute on reinforcement learning, because I think everyone has this intuition that the more RL you add, the more sophisticated you're going to be able to make these things, and a lot o…”
Clark: US and UK AI Safety Institutes Are Testing Frontier AI Systems
“The US and UK are not, don't have regulatory powers. Will they be third parties that test out systems like Claude or ChatGPT or Gemini for national security risks and hold companies accountable to them? Yes. Like I'm in discussion with them today.”
Clark: Frontier AI training costs jumped from thousands to hundreds of millions
“It costs, you know, tens of millions, maybe hundreds of millions of dollars to train these things now. Back in 2019, it cost tens of thousands of dollars.”
Clark: Consumer AI subscriptions will become a massive market like Netflix
“I think there's going to be this very large growing business of basically a subscription model where people will have a personal AI or multiple AIs that they use, just like you or I might have a Netflix account or whatever.”
Clark: Developers will build and release open-source AI agents
“People are definitely going to build, like, open source agents and release them as well, and we're going to have to contend with that where the environment of the internet will be changed by this in a bunch of hard to predict ways.”
Clark: Claude 3 is far more complex and weird to explore than previous LLMs
“The only claim I'm going to make is it certainly got a lot more complicated and weird to explore than previous systems or other language models that have been developed.”
Clark: Anthropic does not train models on Claude user conversations
“No, no, no, no. That is not a thing that we do at all. Yeah.”
Clark: AI-native startups will do much more with fewer people
“My bet is that you're going to see new companies get formed, which do a lot more with a lot less in terms of people. They're going to figure out how to be, like, much smarter and perform a lot better than that than equivalently scaled companies that don't use …”