David Luan: Iterative prompting is a flawed interface for AI
David Luan · David Luan: Why Nvidia Will Enter the Model Space & Models Will Enter the Chip Space | E1169 · 20VC with Harry Stebbings · Jun 24, 2024 · at 53:46
David Luan, CEO of Adept, explains why rich, shared-canvas interaction models are superior to text prompting for supervising advanced AI systems.
0:00 / 0:28exact quote · 28.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“You know, when you go work with a coworker, right, you don't just you don't just talk back and forth. You, like, actually, like, share the same canvas. You'll go use a whiteboard. You'll go, like, maybe look at the same thing on the computer together, and then go try to solve the problem together. Like, human-human interaction is, like, way, way, way, way richer than, like, writing a set of instructions and then being like, do this thing, and then when it fails, you come back and you tweak the instructions a little bit. Like, that's just not a very, like, especially as these systems become more and more smart, That's just a really bad way to go interact with them.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from David Luan
Luan: Vertical integration pressure will merge model builders and chip makers
“That's my expectation. To me, like what's interesting about AI from a business side, right, is like it forces the question of like, what Companies or offerings are going to be bundled or integrated and which ones are going to get unbundled. And I actually thin…”
Luan: Leading AI companies are already lobbying for regulatory capture
“I think I think the move to go pull up the ladder behind them is already beginning. And I think that lawmakers don't really understand this technology at all. And so their default instinct is sort of listened to the most credible source. And usually those cred…”
Luan: AI scaling will not suffer diminishing returns on compute
“The second way of improving model performance is just starting to be tapped now, and that's also going to absorb a boatload of compute. So because of that, I actually am not worried about diminishing returns to the compute over time.”
Luan: Base AI model performance requires doubling compute for consistent gains
“So put another way for just scaling up a base language model you need to double the amount of compute for that language model for it to be predictably consistently smarter.”
Luan: AI model progress is pivoting to synthetic data and reinforcement learning
“Now the critical path for model improvement is, is is shifting over to this to this sort of broader sort of simulation slash synthetic data slash like RL loop sort of path. I think it's just a natural consequence of the fact that it's so expensive to just keep…”