AGI should be defined operationally as an AI that automates AI research
Dwarkesh Patel · AI Scaling, Alignment, and the Path to Superintelligence — With Dwarkesh Patel · May 15, 2024 · at 32:23
Host Alex Kantrowitz asks Dwarkesh Patel how he defines Artificial General Intelligence (AGI) amidst widespread industry ambiguity.
0:00 / 0:14exact quote · 14.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The way I've been thinking about it, which is, which has less to do with like maybe AGI in the world and more so about, I think it's long-term impact is the kind of model which can automate or significantly speed up AI research.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dwarkesh Patel
Patel: Individuals will eventually train superintelligences in basements
“The cost of training, the systems is declining so fast that Literally you will be able to train a super intelligence in a basement at some point in the future.”
Dwarkesh: AGI requires further algorithmic progress, not just current model scaling
“I don't think we're just right around our corner from AGI and it's just a little additional dash of something. That's all it's going to take. I think, you know, people often ask if all AI progress stopped right now and all you could do is collect more data or …”
Dwarkesh: Lack of continual learning prevents LLMs from replacing human labor
“I think a big bottleneck these models have is their inability to learn on the job, to have continual learning. Their entire memory is extinguished at the end of a session. There's a bunch of reasons why I think this actually makes it really hard to get human-l…”
Patel: Reinforcement learning may not generalize beyond verifiable domains
“I still think I I'm like, I'm not confident that this will generalize to domains that are not so verifiable or text-based.”