Chen: Robotics will propel AI forward through grounded, embodied physical data
Peter Chen · No Priors Ep. 48 | With Covariant CEO Peter Chen · Jan 24, 2024 · at 2:28
Peter Chen is the co-founder and CEO of Covariant and a former OpenAI researcher, discussing the connection between embodied AI and foundation model progress with Sarah Guo.
0:00 / 0:25exact quote · 25.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And so we found robotics to be such a great way to both utilize the advances in AI, but also we think of it as a way to also propel AI forward. Like this is where you get the grounded data. This is where you get that embodied data of not just AI that is trained on browsing the internet, but AI that is trained with physical interactions with the world. And so we also believe robotics would be a key way to advance AI.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Peter Chen
Chen: Scaling robotics foundation models requires commercial robot fleets, not labs
“And the only way to collect enough data is to build fleets of robots that are actually creating value for customers that, so that you can collect those data in production. Because even if you try to scale up data collection in a lab environment, There's a limi…”
Chen: Robotics value does not require emergent scaling due to domain data coverage
“You kind of don't need that when you are in a more Restricted domain, like robotics because like you actually could have so much data coverage that your test scenarios are just part of your training scenario. So to some degree, like we actually don't need to r…”
Chen: Simulating robotic manipulation is harder than autonomous driving due to contact
“When you think about simulation in self-driving car, like we are really mostly thinking about systems that hopefully don't physically interact with each other, right? Like if two cars get in contact with each other, that's a really terrible thing, right? And s…”
Chen: Next-token LLM training is mimicry, imposing a natural capability ceiling
“For people that study reinforcement learning, we call it behavior cloning, which means you're just asking the AI to clone the behavior of another agent. And that is like one of the most primitive way possible to train this type of systems. Like, because if you…”