Luan: AGI means performing any task a human can do on a computer
David Luan · Why Google failed to make GPT-3 -- with David Luan of Adept · Mar 27, 2024 · at 4:34
David Luan, co-founder of Adept and former VP of Engineering at OpenAI, discusses how to define artificial general intelligence (AGI) and why software agents are the right path toward it.
0:00 / 0:37exact quote · 38.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think agents are just absolutely the correct long-term direction, right? You just go to find what AGI is, right? You're like, hey, like, Well, first off, actually, I don't love AGI definitions that involve human replacement because I don't think that's actually how it's going to happen. I think even this definition of, like, AGI is something that outperforms humans at economically valuable tasks is, like, is kind of a, you know, like implicit, like, view of the world about, like, how, what are, what's going to be the role of people. I think I think what I'm more interested in is, like, a definition of AGI that's oriented around, like, a model that can do anything a human can do on a computer. And I think, like, if you go think about that, which is, like, super tractable, Then like agent is like just a natural consequence of that definition.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from David Luan
Google would have crushed OpenAI by giving Noam Shazeer half its TPUs
“That muscle did not exist during my time at Google. And I think had they had it, what they would have done would be say, hey, Noam Shazir, you're a brilliant guy. You know how to scale these things up? Like, here's half of all of our TPUs. And then I think the…”
Luan: LLMs shortcut evolutionary RL by behaviorally cloning all human knowledge
“Like de novo RL is like a pretty terrible way to get there quickly. Why are we rediscovering all the knowledge about the world? Like years ago, I had a debate with a Berkeley professor as to like what will it actually take to build HCI? And his view is basical…”
Luan: AI will converge into a universal byte model across all modalities
“Multimodal models are becoming more of a thing, we're behavioral cloning the visual world, but really what we're just going to have is this like universal byte model, right? Where like tokens of data that have high signal come in, and then all of those pattern…”
Luan: Augmentation develops core AI capabilities faster than full automation
“I actually think that being an augmentation company Forces you to go develop your core AI capabilities faster than someone who's saying, ah, ok, my job is to deliver you a lights off solution for X.”
Luan: Future AI value will shift from base models to agents
“In a world where foundation models are looking more and more commodity. And if, and I think a huge amount of gain is going to happen from how do you use foundation models as like the, like well learned behavioral cloner to go solve agents.”