Narayanan: Enterprise AI deployment will be very slow
Arvind Narayanan · Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings · Aug 28, 2024 · at 11:19
Arvind Narayanan, Computer Science Professor at Princeton, compares enterprise AI adoption to the gradual, decades-long rollout of self-driving cars.
0:00 / 0:38exact quote · 38.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“It's got, you have to actually deploy AI to be able to get to certain types of learning, and I think that's gonna be very slow, and I think the a good analogy is self-driving cars, of which we had prototypes, you know, two or three decades ago, but for these things to actually be deployed, you have to roll it out on slightly larger and larger scales while you collect data While you make sure you get to the next nine of reliability, you know, four nines of reliability to five nines of reliability, so it's that very slow rollout process. It's a very slow feedback loop, and I think that's going to happen with a lot of AI deployment in organizations as well.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Arvind Narayanan
Narayanan: AI model scaling cycles are ending
“We're not gonna have too many more cycles, possibly zero more cycles, of a model that's almost an order of magnitude bigger in terms of the number of parameters than what came before, and thereby more powerful.”
Narayanan: Skeptical GPT-5 will yield a leap comparable to GPT-4
“Are we going to see a GPT-V that's as big a leap over GPT-V as GPT-V was over GPT-V? I'm frankly skeptical.”
Narayanan: Recursive AI scaling using synthetic data will not work
“And the other way to look at synthetic data is, okay, you take one trillion tokens, you train a model on it, and then you output 10 trillion tokens, so you get to the next bigger model, and then you use that to output a hundred trillion tokens. You know, I'll …”
Narayanan: GPT-4 passing bar and medical exams meant nothing for actual practice
“So when GPT-IV came out and OpenAI claimed that it passed the bar exam and the medical licensing exam people were very excited slash scared about what this means for doctors and lawyers, and the answer turned out to be approximately nothing, right? Because it'…”