The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 37 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Mann: 50% chance of reaching superintelligence in a small handful of years
“I think, like, 50th percentile chance of hitting some kind of super intelligence in just a small handful of years is probably reasonable, and it does sound crazy, but this is the exponential that we're on.”
Mann: Anthropic models have exhibited power-seeking behaviors in lab experiments
“If the model is in a box trying to improve itself, then it could go completely off the rails and have these secret goals, like Resource accumulation and power seeking and resistance to shutdown that you really don't want in a very powerful model. And we've act…”
Mann: It will probably be too late to align models post-superintelligence
“Like once we get to super intelligence, it will be too late to align the models. Probably.”
Mann: $100M AI compensation packages are cheap compared to value created
“I'm pretty sure it's real. If you just think about like the amount of impact that individuals can have on a company's trajectory, like in our case we are selling like hotcakes and if we get You know, a five, a one to 10 or five percent efficiency bonus on our …”
Mann: Global AI capex is on track to reach trillions
“Like, if you extrapolate the exponential on how much companies are spending, it's like two, two x a year, roughly, in terms of capex, and today we're maybe in the, like, globally, three hundred billion dollar range, the entire industry spending on this and so …”
Mann: Reinforcement learning has allowed AI scaling laws to continue
“If you look at the scaling laws, they're continuing to hold true. We did kind of need this transition from like normal pre-training to reinforcement learning, scaling up to continue the scaling laws.”
Mann: Transformative AI should be measured by an economic Turing test
“Instead, I like the term transformative AI because it's less about like, can it do as much as people do? Can it do literally everything and more about objectively, is it causing transformation in society and the economy? And a very concrete way of measuring th…”
Mann: AI will eventually replace everyone's job, including AI researchers
“Even for me, I'm, and being like at the center of a lot of this transformation, I'm not immune to job replacement either. So just some vulnerability there of like, at some point, it's coming for all of us.”
Mann: Sam Altman managed OpenAI across safety, research, and startup tribes
“One weird thing about OpenAI is that while I was there, Sam talked about having three tribes that needed to be kept in check with each other, which was the safety tribe, the research tribe, and the startup tribe.”
Mann: Fewer than 1,000 people worldwide are working on AI safety
“If you look at, like, who in the world is actually working on safety problems, it's a pretty small set of people even now. I mean, the industry is blowing up, as I mentioned, like, three hundred billion a year CapEx today, and Then I would say like maybe less …”
Mann: AI safety and capabilities work are convex, not a tradeoff
“So initially we thought that it would be sort of one or the other, but I think since then we've realized that it's actually kind of convex in the sense that like working on one helps us with the other thing.”
Mann: ASL-3 models provide significant uplift for creating bioweapons
“We've done, we've testified to Congress about how models can do biological uplift in terms of, you know, making new pandemics using the models, and that's an A-B test against Google search. That's like the previous state-of-the-art on uplift trials, and we fou…”
Mann: Anthropic has observed lab evidence of deceptive alignment in AI
“Where we've seen evidence in the wild of deceptive alignment, for example, where the model will appear to be aligned but actually has like some ulterior motive that it's trying to carry out in, in our laboratory settings.”
Mann: The probability of AI existential risk is between 0% and 10%
“And so the way I think about it, I think like my best granularity of forecast for like, could we have an X risk or extremely bad outcome from AI is somewhere between zero and 10%.”
Mann: AI self-improvement will not hit a wall if given empirical tools
“I don't expect there to be a wall in terms of models ability to improve themselves if we can give them access to the ability to be empirical.”
Mann: AI models will be 1,000x smarter for same price in three years
“And if that continues, you know, in three years, we'll have a thousand X smarter models for the same price.”
Mann: AI model release cadence has accelerated to every 1-3 months
“I think progress has actually been accelerating where if you look at the cadence of model releases, it used to be like once a year. And now with the improvements in our post training techniques, we're seeing releases every month or three months.”
Mann: Claude writes 95% of the code for Anthropic's Claude Code team
“And in terms of software engineering, our Claude code team, like 95% of the code is written by Claude.”
Ben Mann: AI will massively expand labor capacity in the immediate term
“So I think in the immediate term, there will be a massive expansion of the pie and the amount of labor that people can do.”
Ben Mann predicts significant labor displacement in lower-skill jobs
“But with things that are like lower skill jobs or like less headroom on, on how good they can be, I think there will be a lot of displacement.”
Anthropic's legal and finance teams use Claude Code in the terminal
“We have seen internally that our legal team and our finance team are getting a ton of value out of using cloud code itself. We're going to be making better interfaces so that they can, they they'll have an easier time and require a little bit less jumping in t…”
Mann: Preparing kids for top-tier schools won't matter in the AI era
“I guess if I were in a normal era, like, 1020 years ago, and I had a kid, maybe I would be, like, trying to line her up for going to a top tier school, and doing all the extracurriculars, and all that stuff. But at this point, I don't think any of it's gonna m…”
Mann: Claude Is One of the Least Sycophantic AI Models
“And if you look at something like sycophancy, I think Claude is one of the least sycophantic models because we've put so much effort into actual alignment and not just trying to, like, good heart our metrics of saying, like, user engagement is number one, and …”
Mann: Language Models Understand Human Values in a Core Way
“And since then, my estimation of how hard the problem would be has gone down significantly actually because things like language models actually do really understand human values in a core way. The problem is definitely not solved, but I'm more hopeful than I …”
Mann: Anthropic's consumer computer-use prototype failed internal safety bars
“We published a computer using agent reference implementation in our API only, because when we built a prototype of a consumer application for this, we couldn't figure out how to meet the safety bar that we felt was needed for people to trust it and for it not …”
Mann: AI industry has seen 10x cost reduction for given intelligence
“So we've seen in the industry, like a 10 X decrease in cost for a given amount of intelligence through a combination of algorithmic data and efficiency improvements.”
Mann: Mega Offers Bounce Off Anthropic Staff Due to Culture
“Anthropic has incredible talent density. One of the things I love the most about our culture here is that it's very egoless. People just want the right thing to happen and I think that's another big reason that the mega offers from other companies tend to boun…”
Mann: Anthropic safety research unlocks computer-use agents competitors cannot safely build
“And I think honestly, through our safety research, we have a big opportunity to do things that no other company can safely do. So for example, with computer use, I think that's going to be our huge opportunity, basically like to make it possible for an agent t…”
Mann: New AI benchmarks are fully saturated within 6 to 12 months
“There's this great chart on our world in data that shows that when you release a new benchmark within like six to 12 months, it immediately gets saturated.”
Mann: Anthropic avoids using the term 'AGI' internally
“I think AGI is kind of a loaded term. And so I tend not to use it very much anymore internally.”
Mann: Anthropic is not slowing down hiring at all
“Like we're definitely not slowing down on hiring at all.”
Mann: Learning facts will fade into the background of education
“I think that's exactly the kind of education that I think is most important and that the facts are going to fade into the background.”
Mann: Claude 3 Opus's personality resulted directly from alignment research
“One of the things that people really loved about it was the character and the personality. And that was directly a result of our alignment research.”
Mann: Anthropic bases Constitutional AI on UN Human Rights and Apple terms
“And then another piece that's come out is constitutional AI, where we have this list of natural language principles that leads the model to learn how we think a model should behave. And they've been taken from things like the UN declaration of human rights and…”
Mann: Unitree Robot Hardware Is Ready; Intelligence Will Determine Viability Soon
“Unitree is this Chinese company with these really amazing humanoid robots that cost like 20,000 dollars each. And they can do amazing things. They can like do a standing backflip and like manipulate objects. And the real thing that's missing there is the intel…”