Arvind Narayanan

Professor of Computer Science, Princeton University · 1 appearance on the record.

computed by AI from the episodes · how this works → · full disclaimer →

academicscientistauthor@random_walker ↗cs.princeton.edu/~arvindn ↗Wikipedia ↗

Arvind Narayanan is a professor of computer science and director of the Center for Information Technology Policy at Princeton University. He is known for research in data privacy and de-anonymization and has co-authored books including AI Snake Oil.

36statements → 20claims → 4claims resolved → 100%fully supported → 3.64/5average certainty → 3.08/5average debate potential → 4.6/5argument clarity · the sources → 3said about them ↓

4 supported 0 partly supported 0 contradicted 2 not yet assessed 14 not checkable as stated how the 20 claims stand · each chip opens the sources

11 predictions · 9 assertions · 9 opinions · 6 insights · 1 disclosure · every statement was checked. The predictions and assertions are the 20 claims: statements the public record can support or contradict. 4 are resolved, 2 are not yet assessed, and 14 name no date, number or outcome precise enough to check. Everything else (opinions, insights, what ifs, disclosures) can never be settled by the record, so it carries no assessment.

The record, in short

What the tape says about how Arvind argues and how the claims held up. Everything they said, and everything said about them, is in the tabs below.

Their most notable supported claim

Prediction Held up
Narayanan: Restricting global access to AI models will fail
“Even if one country decides that models should be closed, the odds of getting every country to enact that kind of, ah, ah, rule are, you know, just vanishingly small. So if our approach to safety with AI is going to be premised on ensuring that quote unquote b…”
Arvind Narayanan Aug 28, 2024 ▶ 42:54 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings

Expressed certainty vs assessment result

none yet certainty 1
none yet certainty 2
none yet certainty 3
100% certainty 4
100% certainty 5

weighted support: a fully supported claim counts one, a partly supported claim counts half. Each filled bar is clickable and opens exactly those claims; "none yet" means nothing said at that certainty level has resolved yet

Argument clarity: do they answer the question? how? →

4.6 / 5 directness 4.7 · coherence 4.9 · precision 4.4 · compression 4.1

redirected or did not address 1 of 39 assessed questions (3%). Watch them ▸

This is a score against a rubric. It is not a rank. Every host question → answer exchange is scored with names hidden on directness, coherence, precision and compression, 1–5 each, on meaning alone: disfluencies are ignored, and only raw unedited episodes count. This is the score that measures thought. Every scored exchange, scores shown → · The rubric and its checks →

How they sound: speaking style how? →

246 words/min while actually speaking · 32.7 um and uh per 1k words · 7.3 false starts per 1k · 32.6% of pauses land inside a clause

Measured by listening to the audio itself: 7,228 words across 1 episode of raw-level tape, transcribed verbatim with every um and uh kept, each one attributed only where the alignment onto our timed stream is unambiguous. These are measurements of speaking style. We do not rank them: across this corpus, fluency and argument quality are nearly uncorrelated (ρ≈0.2), and smooth talking does not signal clear thinking. How it's measured →

Everything Arvind Narayanan said on 20VC that made the record, most notable first. Filter by type, assessment or year in the ledger →

Assertion Not checkable as stated
Narayanan: AI developers over-optimize models for benchmarks over real-world performance
“When there is so much pressure to do well on these benchmarks, developers are intentionally or unintentionally optimizing these models In ways that look good on the benchmarks, but don't look good in real world evaluation.”
Arvind Narayanan Aug 28, 2024 ▶ 18:25 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Opinion
Narayanan: Do not trust overconfident AGI predictions from tech CEOs
“I wouldn't put too much stock into these overconfident predictions from CEOs.”
Arvind Narayanan Aug 28, 2024 ▶ 21:54 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Opinion
Narayanan: AI companies should help cover education system adaptation costs
“It forces a lot of costs upon the education system, and ideally, AI companies should be bearing some of that cost.”
Arvind Narayanan Aug 28, 2024 ▶ 35:52 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Insight
Narayanan: AI developers mistakenly assume average learners are self-taught
“You have a lot of AI developers who are thinking of themselves as the typical learner, and they're not.”
Arvind Narayanan Aug 28, 2024 ▶ 39:42 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Prediction Not checkable as stated
Narayanan: AI tools will not become the default way people learn anytime soon
“I'm very skeptical that these new kinds of learning are going to get to a point anytime soon where they're going to become the default way in which people learn.”
Arvind Narayanan Aug 28, 2024 ▶ 40:17 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Insight
Narayanan: AI automates individual tasks, not entire jobs
“You know, the more abstract way of saying that is, as economists would put it, jobs are bundles of tasks, And AI automates tasks, not jobs. So if there are, you know, 20 different tasks that comprise a job the odds that AI is gonna be able to automate all 20 o…”
Arvind Narayanan Aug 28, 2024 ▶ 41:13 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Assertion Not checkable as stated
Narayanan: Nvidia is trying aggressively to migrate from hardware to services
“I do find it interesting that NVIDIA itself Has been trying to migrate really, really hard out of hardware into becoming a services company.”
Arvind Narayanan Aug 28, 2024 ▶ 47:47 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Insight
Narayanan: AI training data quality matters far more than quantity
“What we've learned in the last two years is that the quality of data matters a lot more than the quantity of data.”
Arvind Narayanan Aug 28, 2024 ▶ 9:09 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Assertion Supported
Narayanan: Inference costs dominate training costs for popular AI models
“Over the lifetime of a model, when you have billions of people using it, the inference cost actually adds up, and for many of the popular models, that's the cost that dominates.”
Arvind Narayanan Aug 28, 2024 ▶ 15:33 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Prediction Not checkable as stated
Narayanan: AI proliferation will force people onto trusted news sources
“That's right. So that, that actually is our prediction. People we predict are going to be forced to rely much more on getting their news from trusted sources.”
Arvind Narayanan Aug 28, 2024 ▶ 31:08 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Prediction Not checkable as stated
Narayanan: Near state-of-the-art AI on personal devices will accelerate
“We have you know, close to state of the art AI models that can already run on people's personal devices, and I think that trend is only going to accelerate.”
Arvind Narayanan Aug 28, 2024 ▶ 42:40 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings
Disclosure
Narayanan: GPT-4's 18-month training period created an illusion of rapid progress
“So I think, like a lot of people, I was fooled by how quickly after GPT-III.V, GPT-IV came out. It was just, you know, three months or so, but it had been in training for 18 months.”
Arvind Narayanan Aug 28, 2024 ▶ 44:24 Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Models | E1195 · 20VC with Harry Stebbings

The other half of the tape: Arvind Narayanan's own voice is left out of every number here. Other people bring the name up 3 times in 1 episode on 20VC. every mention, with the transcript →

Who brings them up most Harry Stebbings 3

Every mention by year

tap a year for its mentions
0021312024episodesmentions
0112024episodes it came up in
001.50.5312024episodesmentions per episode

Appearances (1)

EpisodeDateSpeaking time
Arvind Narayanan: AI Scaling Myths, The Core Bottlenecks in AI Today & The Future of Model Aug 28, 2024 35m
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.