Narayanan: Comparing AI to nuclear weapons is a category error
Arvind Narayanan · Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings · Aug 28, 2024 · at 41:59
Princeton CS professor Arvind Narayanan pushes back on Scale AI CEO Alex Wang's assertion that AI has the potential to be a bigger weapon than nuclear arms.
0:00 / 0:07exact quote · 7.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think it's a bit of a category error there. I mean, a nuclear weapon is an actual weapon. AI is not a weapon.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Arvind Narayanan
Narayanan: AI model scaling cycles are ending
“We're not gonna have too many more cycles, possibly zero more cycles, of a model that's almost an order of magnitude bigger in terms of the number of parameters than what came before, and thereby more powerful.”
Narayanan: Skeptical GPT-5 will yield a leap comparable to GPT-4
“Are we going to see a GPT-V that's as big a leap over GPT-V as GPT-V was over GPT-V? I'm frankly skeptical.”
Narayanan: Recursive AI scaling using synthetic data will not work
“And the other way to look at synthetic data is, okay, you take one trillion tokens, you train a model on it, and then you output 10 trillion tokens, so you get to the next bigger model, and then you use that to output a hundred trillion tokens. You know, I'll …”
Narayanan: GPT-4 passing bar and medical exams meant nothing for actual practice
“So when GPT-IV came out and OpenAI claimed that it passed the bar exam and the medical licensing exam people were very excited slash scared about what this means for doctors and lawyers, and the answer turned out to be approximately nothing, right? Because it'…”
Narayanan: AI bots influencing elections with misinformation is not a real danger
“So people have been worried, for instance, about bots creating misinformation with AI and influence in elections and that sort of thing. We're very, very skeptical that that's going to be a real danger.”
Narayanan: Restricting global access to AI models will fail
“Even if one country decides that models should be closed, the odds of getting every country to enact that kind of, ah, ah, rule are, you know, just vanishingly small. So if our approach to safety with AI is going to be premised on ensuring that quote unquote b…”