Multi-hour autonomous coherency is a major bottleneck for agentic AI
Dwarkesh Patel · AI Scaling, Alignment, and the Path to Superintelligence — With Dwarkesh Patel · May 15, 2024 · at 34:30
Dwarkesh Patel, host of the Dwarkesh Podcast, discusses the architectural and behavioral hurdles AI models face in transitioning from chatbots to autonomous agents.
0:00 / 0:43exact quote · 43.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“One big one, and this is similar, is that they aren't yet useful in long when you need them to kind of go do a job. You can't be like GPT-IV. I'll be back in a while, but can you like manage my inbox for me in the meantime? Or can you go go book a trip for me? You know, just like things that require them to sort of autonomously hold themselves together. For a while and act as an agent. And so just that kind of coherency where they go from five minutes of being able to be in dialogue with you to you just like tell them to do something. You come back a couple hours later and they've just done a bunch of inference to make it happen. I think that will be a huge bottleneck or a huge unlock.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dwarkesh Patel
Patel: Individuals will eventually train superintelligences in basements
“The cost of training, the systems is declining so fast that Literally you will be able to train a super intelligence in a basement at some point in the future.”
Dwarkesh: AGI requires further algorithmic progress, not just current model scaling
“I don't think we're just right around our corner from AGI and it's just a little additional dash of something. That's all it's going to take. I think, you know, people often ask if all AI progress stopped right now and all you could do is collect more data or …”
Dwarkesh: Lack of continual learning prevents LLMs from replacing human labor
“I think a big bottleneck these models have is their inability to learn on the job, to have continual learning. Their entire memory is extinguished at the end of a session. There's a bunch of reasons why I think this actually makes it really hard to get human-l…”
Patel: Reinforcement learning may not generalize beyond verifiable domains
“I still think I I'm like, I'm not confident that this will generalize to domains that are not so verifiable or text-based.”