The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 20 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 2 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Narayanan: AI model scaling cycles are ending
“We're not gonna have too many more cycles, possibly zero more cycles, of a model that's almost an order of magnitude bigger in terms of the number of parameters than what came before, and thereby more powerful.”
Narayanan: Skeptical GPT-5 will yield a leap comparable to GPT-4
“Are we going to see a GPT-V that's as big a leap over GPT-V as GPT-V was over GPT-V? I'm frankly skeptical.”
Narayanan: Recursive AI scaling using synthetic data will not work
“And the other way to look at synthetic data is, okay, you take one trillion tokens, you train a model on it, and then you output 10 trillion tokens, so you get to the next bigger model, and then you use that to output a hundred trillion tokens. You know, I'll …”
Narayanan: AI bots influencing elections with misinformation is not a real danger
“So people have been worried, for instance, about bots creating misinformation with AI and influence in elections and that sort of thing. We're very, very skeptical that that's going to be a real danger.”
Narayanan: Restricting global access to AI models will fail
“Even if one country decides that models should be closed, the odds of getting every country to enact that kind of, ah, ah, rule are, you know, just vanishingly small. So if our approach to safety with AI is going to be premised on ensuring that quote unquote b…”
Narayanan: No AI model has meaningfully surpassed GPT-4 in 18 months
“And what we've seen in the nearly year and a half since GPT-IV came out is that we haven't really had models That have surpassed it in a meaningful way.”
Narayanan: Fears of spontaneous AI consciousness have no basis in reality
“When we look at the way that AI is architected today, that kind of fear has no basis in reality. Maybe one day in the future, you know, people are going to build AI systems where that becomes at least somewhat possible. And we should, you know, we should have …”
Narayanan: AI models have exhausted accessible training data
“These models are already trained on essentially all of the data that companies can get their hands on.”
Narayanan: YouTube transcript text is an order of magnitude smaller than current AI training sets
“A hundred and fifty billion hours of video sounds, you know, really impressive. But when you put that video through a speech recognizer and actually extracts the text tokens out of it and deduplicated and so forth, it's actually not that much. It's an order of…”
Narayanan: Enterprise AI deployment will be very slow
“It's got, you have to actually deploy AI to be able to get to certain types of learning, and I think that's gonna be very slow, and I think the a good analogy is self-driving cars, of which we had prototypes, you know, two or three decades ago, but for these t…”
Narayanan: Lower AI inference costs will increase total enterprise AI spend
“And I predict that we're going to see the same thing with models when models get cheaper. They're put into a lot more things, and so the total amount that companies are spending on inference is actually going to increase.”
Narayanan: Exponential AI growth will flatten and models will commoditize
“So I think that's going to happen both with models as well as with these hardware cycles. You know, I can't predict how long that's going to take, but we are, I think, going to get to a world where models do get commoditized.”
Narayanan: OpenAI focuses on products as researchers depart to Anthropic
“Folks focused on superintelligence didn't feel very welcome at the company, and there has been an exodus of very prominent people, and Anthropic has picked up a lot of them. So it seems like we're seeing a split emerging where OpenAI is more focused on product…”
Narayanan: No reliable method exists to detect AI-generated text
“There's no way really to catch AI-generated text or homework answers.”
Narayanan: AI developers over-optimize models for benchmarks over real-world performance
“When there is so much pressure to do well on these benchmarks, developers are intentionally or unintentionally optimizing these models In ways that look good on the benchmarks, but don't look good in real world evaluation.”
Narayanan: AI tools will not become the default way people learn anytime soon
“I'm very skeptical that these new kinds of learning are going to get to a point anytime soon where they're going to become the default way in which people learn.”
Narayanan: Nvidia is trying aggressively to migrate from hardware to services
“I do find it interesting that NVIDIA itself Has been trying to migrate really, really hard out of hardware into becoming a services company.”
Narayanan: Inference costs dominate training costs for popular AI models
“Over the lifetime of a model, when you have billions of people using it, the inference cost actually adds up, and for many of the popular models, that's the cost that dominates.”