The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 36 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 2 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Narayanan: AI model scaling cycles are ending
“We're not gonna have too many more cycles, possibly zero more cycles, of a model that's almost an order of magnitude bigger in terms of the number of parameters than what came before, and thereby more powerful.”
Narayanan: Skeptical GPT-5 will yield a leap comparable to GPT-4
“Are we going to see a GPT-V that's as big a leap over GPT-V as GPT-V was over GPT-V? I'm frankly skeptical.”
Narayanan: Recursive AI scaling using synthetic data will not work
“And the other way to look at synthetic data is, okay, you take one trillion tokens, you train a model on it, and then you output 10 trillion tokens, so you get to the next bigger model, and then you use that to output a hundred trillion tokens. You know, I'll …”
Narayanan: GPT-4 passing bar and medical exams meant nothing for actual practice
“So when GPT-IV came out and OpenAI claimed that it passed the bar exam and the medical licensing exam people were very excited slash scared about what this means for doctors and lawyers, and the answer turned out to be approximately nothing, right? Because it'…”
Narayanan: AI bots influencing elections with misinformation is not a real danger
“So people have been worried, for instance, about bots creating misinformation with AI and influence in elections and that sort of thing. We're very, very skeptical that that's going to be a real danger.”
Narayanan: Comparing AI to nuclear weapons is a category error
“I think it's a bit of a category error there. I mean, a nuclear weapon is an actual weapon. AI is not a weapon.”
Narayanan: Restricting global access to AI models will fail
“Even if one country decides that models should be closed, the odds of getting every country to enact that kind of, ah, ah, rule are, you know, just vanishingly small. So if our approach to safety with AI is going to be premised on ensuring that quote unquote b…”
Narayanan: No AI model has meaningfully surpassed GPT-4 in 18 months
“And what we've seen in the nearly year and a half since GPT-IV came out is that we haven't really had models That have surpassed it in a meaningful way.”
Narayanan: Fears of spontaneous AI consciousness have no basis in reality
“When we look at the way that AI is architected today, that kind of fear has no basis in reality. Maybe one day in the future, you know, people are going to build AI systems where that becomes at least somewhat possible. And we should, you know, we should have …”
Narayanan: AI models have exhausted accessible training data
“These models are already trained on essentially all of the data that companies can get their hands on.”
Narayanan: YouTube transcript text is an order of magnitude smaller than current AI training sets
“A hundred and fifty billion hours of video sounds, you know, really impressive. But when you put that video through a speech recognizer and actually extracts the text tokens out of it and deduplicated and so forth, it's actually not that much. It's an order of…”
Narayanan: Enterprise AI deployment will be very slow
“It's got, you have to actually deploy AI to be able to get to certain types of learning, and I think that's gonna be very slow, and I think the a good analogy is self-driving cars, of which we had prototypes, you know, two or three decades ago, but for these t…”
Narayanan: Enterprise AI adoption is bottlenecked by cost, not capability
“My view is that in a lot of cases, the adoption of these models is not bottlenecked by capability. If these models were actually deployed today to do all the tasks that they're capable of, it would truly be a striking economic transformation. The bottlenecks a…”
Narayanan: Lower AI inference costs will increase total enterprise AI spend
“And I predict that we're going to see the same thing with models when models get cheaper. They're put into a lot more things, and so the total amount that companies are spending on inference is actually going to increase.”
Narayanan: Exponential AI growth will flatten and models will commoditize
“So I think that's going to happen both with models as well as with these hardware cycles. You know, I can't predict how long that's going to take, but we are, I think, going to get to a world where models do get commoditized.”
Narayanan: OpenAI focuses on products as researchers depart to Anthropic
“Folks focused on superintelligence didn't feel very welcome at the company, and there has been an exodus of very prominent people, and Anthropic has picked up a lot of them. So it seems like we're seeing a split emerging where OpenAI is more focused on product…”
Narayanan: Oligopoly of tech giants dominating AI models is serious risk
“That might happen. I think that's a very serious possibility, and I think this is actually one area where regulators should be paying attention. You know, what does this mean for market concentration, antitrust, and so forth?”
Narayanan: Misinformation affirms existing beliefs rather than changing them
“In a way, I think misinformation is more of a symptom than a cause. I think, you know, misinformation slots into and affirms people's existing beliefs as opposed to changing their beliefs. And I think the impact on AI here, again, has been tremendously exagger…”
Narayanan: Misinformation is a social media distribution problem, not an AI generation problem
“To the extent it's a technology problem, it's more of a social media problem, really, than an AI problem, because the hard part of misinformation is not generating it, it's distributing it to people and persuading them, and social media is often the medium for…”
Narayanan: No reliable method exists to detect AI-generated text
“There's no way really to catch AI-generated text or homework answers.”
Narayanan: Public right to AI knowledge overrides private commercial interests
“I don't think I would be a good CEO, but if there were one thing I could change about OpenAI, I think I think the need for the public to know what is going on with AI development overrides the you know, commercial interests of any company, so I think there nee…”
Narayanan: LLMs are an off-ramp to superintelligence requiring new breakthroughs
“I have to say, I really like Jan LeCun's perspectives on various things, including his view that LLMs Our quote unquote off-ramp to super intelligence that, you know, in other words, we need a lot more scientific breakthroughs, as well as tamping down the fear…”
Narayanan: AI is a net positive for society, unlike Bitcoin
“While there are harms around AI, I think it has been a net positive for society. I can't say the same thing about Bitcoin.”
Narayanan: Generative AI companies deluded themselves into ignoring product-market fit
“They didn't think about actually building products, you know, making things that people want, finding product market fit, and all those things that are so basic in tech, but somehow AI companies diluted themselves into thinking that the normal rules don't appl…”
Narayanan: AI developers over-optimize models for benchmarks over real-world performance
“When there is so much pressure to do well on these benchmarks, developers are intentionally or unintentionally optimizing these models In ways that look good on the benchmarks, but don't look good in real world evaluation.”
Narayanan: Do not trust overconfident AGI predictions from tech CEOs
“I wouldn't put too much stock into these overconfident predictions from CEOs.”
Narayanan: AI companies should help cover education system adaptation costs
“It forces a lot of costs upon the education system, and ideally, AI companies should be bearing some of that cost.”
Narayanan: AI developers mistakenly assume average learners are self-taught
“You have a lot of AI developers who are thinking of themselves as the typical learner, and they're not.”
Narayanan: AI tools will not become the default way people learn anytime soon
“I'm very skeptical that these new kinds of learning are going to get to a point anytime soon where they're going to become the default way in which people learn.”
Narayanan: AI automates individual tasks, not entire jobs
“You know, the more abstract way of saying that is, as economists would put it, jobs are bundles of tasks, And AI automates tasks, not jobs. So if there are, you know, 20 different tasks that comprise a job the odds that AI is gonna be able to automate all 20 o…”
Narayanan: Nvidia is trying aggressively to migrate from hardware to services
“I do find it interesting that NVIDIA itself Has been trying to migrate really, really hard out of hardware into becoming a services company.”
Narayanan: AI training data quality matters far more than quantity
“What we've learned in the last two years is that the quality of data matters a lot more than the quantity of data.”
Narayanan: Inference costs dominate training costs for popular AI models
“Over the lifetime of a model, when you have billions of people using it, the inference cost actually adds up, and for many of the popular models, that's the cost that dominates.”
Narayanan: AI proliferation will force people onto trusted news sources
“That's right. So that, that actually is our prediction. People we predict are going to be forced to rely much more on getting their news from trusted sources.”