Real-world computer workflows with end-to-end API coverage are close to zero
David Luan · Why Google failed to make GPT-3 -- with David Luan of Adept · Mar 27, 2024 · at 31:53
Adept founder David Luan explains why building AI agents to control graphical user interfaces like humans do is necessary, comparing it to humanoid robotics.
0:00 / 0:08exact quote · 8.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“If you go itemize out the number of things you want to do on your computer for which every step has an API those numbers of workflows add up pretty close to zero.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from David Luan
Google would have crushed OpenAI by giving Noam Shazeer half its TPUs
“That muscle did not exist during my time at Google. And I think had they had it, what they would have done would be say, hey, Noam Shazir, you're a brilliant guy. You know how to scale these things up? Like, here's half of all of our TPUs. And then I think the…”
Luan: AGI means performing any task a human can do on a computer
“I think agents are just absolutely the correct long-term direction, right? You just go to find what AGI is, right? You're like, hey, like, Well, first off, actually, I don't love AGI definitions that involve human replacement because I don't think that's actua…”
Luan: LLMs shortcut evolutionary RL by behaviorally cloning all human knowledge
“Like de novo RL is like a pretty terrible way to get there quickly. Why are we rediscovering all the knowledge about the world? Like years ago, I had a debate with a Berkeley professor as to like what will it actually take to build HCI? And his view is basical…”
Luan: AI will converge into a universal byte model across all modalities
“Multimodal models are becoming more of a thing, we're behavioral cloning the visual world, but really what we're just going to have is this like universal byte model, right? Where like tokens of data that have high signal come in, and then all of those pattern…”
Luan: Augmentation develops core AI capabilities faster than full automation
“I actually think that being an augmentation company Forces you to go develop your core AI capabilities faster than someone who's saying, ah, ok, my job is to deliver you a lights off solution for X.”
Luan: Future AI value will shift from base models to agents
“In a world where foundation models are looking more and more commodity. And if, and I think a huge amount of gain is going to happen from how do you use foundation models as like the, like well learned behavioral cloner to go solve agents.”