Everything David Luan said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Luan: AGI means performing any task a human can do on a computer
“I think agents are just absolutely the correct long-term direction, right? You just go to find what AGI is, right? You're like, hey, like, Well, first off, actually, I don't love AGI definitions that involve human replacement because I don't think that's actua…”
Luan: LLMs shortcut evolutionary RL by behaviorally cloning all human knowledge
“Like de novo RL is like a pretty terrible way to get there quickly. Why are we rediscovering all the knowledge about the world? Like years ago, I had a debate with a Berkeley professor as to like what will it actually take to build HCI? And his view is basical…”
Luan: AI will converge into a universal byte model across all modalities
“Multimodal models are becoming more of a thing, we're behavioral cloning the visual world, but really what we're just going to have is this like universal byte model, right? Where like tokens of data that have high signal come in, and then all of those pattern…”
Luan: Augmentation develops core AI capabilities faster than full automation
“I actually think that being an augmentation company Forces you to go develop your core AI capabilities faster than someone who's saying, ah, ok, my job is to deliver you a lights off solution for X.”
Luan: Future AI value will shift from base models to agents
“In a world where foundation models are looking more and more commodity. And if, and I think a huge amount of gain is going to happen from how do you use foundation models as like the, like well learned behavioral cloner to go solve agents.”
Multimodal models will completely supplant text-only large language models
“I actually think like it's really clear today. Multimodal models are the default foundation model, right? It's just going to supplant LLMs. Like why did you just train a giant multimodal model?”
Real-world computer workflows with end-to-end API coverage are close to zero
“If you go itemize out the number of things you want to do on your computer for which every step has an API those numbers of workflows add up pretty close to zero.”
Pure-play foundation model companies will be commoditized by Llama and big tech
“I think pure play foundation model companies are just gonna be pinched by how good The next couple of llamas are going to be, and the next, like, what next good open source thing, and then seeing the really big players put ridiculous amounts of compute behind …”
Luan: Training foundation models for robotics via behavioral cloning will work
“One, I'm so excited for someone to train a foundation model of robots. Like, it's just, I think it's just gonna work. Like, I will die on this hill. I mean, like, again, this whole time, like, we've been on this podcast, just continually saying, you know, like…”
Luan: AI cyber attack risk is 10x to 100x larger than disinformation
“I think it's like 10 x larger than the disinformation problem, if not a hundred x larger. In a world where these models are much more easily used as a mechanism for attack than a mechanism for defense, there's gonna be this period of time over the next couple …”
Luan: 2012-2018 AI breakthroughs came from bottom-up curiosity without corporate objectives
“During that twenty-twelve, twenty-eighteen era, the way people made progress what I mean by bottom-up basic research is you hire the most brilliant scientists, they come to work every day with, like, No near-term objective they're being held accountable to. An…”
Luan: ChatGPT was just GPT-3 with instruction tuning released a year later
“ChatGPT was really just GPT-III with instruction. It was basically like more chat tuning, but GPT-III API came out, I think, over a year before ChatGPT did, but only developers could play with it.”
Luan: Scaling GPT-2 without architectural changes unlocked three-digit arithmetic
“When we were training GPT-II, we trained GPT-II in various different sizes. And at the smallest size, the model was just, like, unable to do three-digit arithmetic. But as the models got bigger and bigger and bigger, we didn't change anything else. We just had…”
David Luan: AI reasoning must be solved at the model provider level
“I think the general capability of reasoning will need to be solved at the model provider level. And that's because What you're actually doing is you're not just using the model to reason. You are trying to improve the model's ability to reason, which means the…”
Luan: Every major cloud and LLM provider is developing custom chips
“Every one of the major clouds is working on And every major LLM provider is working on a strategy to have their in-house chips because that way they have better margins.”
Luan: Google's TPU team had under 500 people on a shoestring budget
“I think the TPU team when I was at Google was, like, sub-five hundred people and their budget was a shoestring budget, and yet somehow every generation they taped out quite good chips that were then used to train Gemini and Palm and are used by third parties n…”
Luan: Reliable AI agents require full integration from UI to model
“I do think that in the agent space, it's extremely important that you own the entire stack from what is the end user interface. I think like we were talking about the Apple example earlier, owning the interface gives you tremendous leverage in this era of AI t…”
Adept avoids signing enterprise AI deals funded by experimental budgets
“One of the things we do, for example, is we really try to not sign deals that are coming out of experiment budget because we want quality revenue basically.”
David Luan: Chat interfaces are not the right paradigm for AI
“And so that's why the HCI problem, like people just aren't spending enough time thinking about like chat is obviously not it.”
Luan: Frontier AI advantages come from unpublished, non-academic scaling knowledge
“There's a collection of really hard-wanted knowledge that you get only by being at the frontiers of scale. And that hard-wanted knowledge, a lot of it's not published. A lot of it is, like, stuff that, like, it's actually not even easily reducible to what look…”
Luan: Everyone will have an AI teammate at work within years
“I think in a couple years everyone's going to have access to, like, an AI teammate that they can delegate Arbitrary tasks do at work, and then also be able to, you know, use it to the sounding board and like just be way, way, way more productive”
Luan: Agent failures often stem from unreliable actuators, not models
“Everyone under values the importance of really good sensors and actuators. And actually a lot of what's helped us get a lot of reliability is like a really strong focus on like, actually, why does the model not do this thing? And the non-trivial amount of time…”
Luan: Ad-supported AI models become beholden to advertisers, not end users
“Having an advertiser be the financial party responsible for paying for these services means that ultimately these AI services are beholden to that advertiser and not to the end user.”
Dextro was the first to offer automated video analysis as a service
“We were the first company to figure out how to get this level of analysis of what's happening in videos as a service.”