Karpathy: General robot platforms uniquely enable cross-task transfer learning in AI
Andrej Karpathy · No Priors Ep. 80 | With Andrej Karpathy from OpenAI and Tesla · Sep 5, 2024 · at 11:26
Former Tesla Autopilot lead Andrej Karpathy explains the technical AI advantages of building a single unified robotic platform over specialized hardware.
0:00 / 0:37exact quote · 37.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And then I would say also one last dimension of it is you benefit a ton from like the transfer learning between the different tasks. And in AI, you really want a single neural nut that is multitasking, doing lots of things that's very getting all the intelligence and the capability from. And that's also why language models are so interesting is because you have a single regime, like a text domain, multitasking all these different problems, and they're all sharing knowledge between each other, and it's all coupled in a single neural nut. And I think you want that kind of a platform and you know, you want all the data you collect for leaf picking to benefit all the other tasks. If you're building a special purpose thing for any one thing, you're not going to benefit from a lot of the transferring between all the other tasks, if that makes sense.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Andrej Karpathy
Karpathy: Tesla is ahead of Waymo because software is easier than hardware
“I think, personally, Tesla is ahead of Waymo, and I know it doesn't look like that, but I'm still very bullish on Tesla and its self-driving program. I think that Tesla has a software problem, and I think Waymo has a hardware problem, is the way I put it, and …”
Karpathy: Coding agent failures are user skill issues, not capability limits
“Even if they don't work, I think to a large extent, you feel like it's a skill issue. It's not that the capability is not there. It's that you just haven't found a way to string it together of what's available. Like I just don't, I didn't give good enough inst…”
Karpathy: Claude feels like a teammate, whereas Codex coding agent is dry
“I actually think Claude has a pretty good personality. It feels like a teammate and it's excited with you, et cetera. I would say for example, Codex is a lot more dry which is kind of interesting because in Chashi PT, Codex is like a lot more upbeat and highly…”
Karpathy: Software industry must reconfigure for agent customers instead of humans
“So I think the industry just has to reconfigure in so many ways that it's like the customer is not the human anymore. It's like agents who are acting on behalf of humans. And this refactoring will be, will probably be substantial in certain sense.”
Karpathy: Autonomous agent tool creation will be trivial within three years
“I kind of feel like this kind of stuff that I just talked about, this should be free, like in a year or two or three. There's no bi-coding involved. This is trivial. This is table stakes. This is like any AI, even the open source models, et cetera, can like do…”
Karpathy: Maximizing AI leverage requires removing humans from prompting loops entirely
“To get the most out of the tools that have become available now, you have to remove yourself as the bottleneck. You can't be there to prompt the next thing. You're, you need to take yourself outside
you have to arrange things such that they're completely auto…”