“The most technical definition of scaling law does apply and we have seen it apply in this domain. And it's somewhat not surprising because like if you think about like the scaling law in the most technical sense, which is if you scale up data and you scale up your model capacity and you scale up the compute that you throw at it, you'll get lower loss function, like training loss function out of it.”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from Peter Chen
Insight
Chen: Scaling robotics foundation models requires commercial robot fleets, not labs
“And the only way to collect enough data is to build fleets of robots that are actually creating value for customers that, so that you can collect those data in production. Because even if you try to scale up data collection in a lab environment, There's a limi…”
Peter ChenJan 24, 2024▶ 4:36No Priors Ep. 48 | With Covariant CEO Peter Chen
Insight
Chen: Robotics value does not require emergent scaling due to domain data coverage
“You kind of don't need that when you are in a more Restricted domain, like robotics because like you actually could have so much data coverage that your test scenarios are just part of your training scenario. So to some degree, like we actually don't need to r…”
Peter ChenJan 24, 2024▶ 28:12No Priors Ep. 48 | With Covariant CEO Peter Chen
Insight
Chen: Simulating robotic manipulation is harder than autonomous driving due to contact
“When you think about simulation in self-driving car, like we are really mostly thinking about systems that hopefully don't physically interact with each other, right? Like if two cars get in contact with each other, that's a really terrible thing, right? And s…”
Peter ChenJan 24, 2024▶ 31:05No Priors Ep. 48 | With Covariant CEO Peter Chen
Insight
Chen: Next-token LLM training is mimicry, imposing a natural capability ceiling
“For people that study reinforcement learning, we call it behavior cloning, which means you're just asking the AI to clone the behavior of another agent. And that is like one of the most primitive way possible to train this type of systems. Like, because if you…”
Peter ChenJan 24, 2024▶ 39:24No Priors Ep. 48 | With Covariant CEO Peter Chen
Opinion
Chen: Humanoids are the universal hardware form factor for physical AI
“Humanoid is the universal hardware form factor that can be dropped into any place in our world.”
Peter ChenJan 24, 2024▶ 17:47No Priors Ep. 48 | With Covariant CEO Peter Chen
AssertionNot checkable as stated
Peter Chen: All Covariant robots feed learning into a single foundation model
“All of these customers, all of these different robots are networked together. Like it's one single foundation model. And everything that they learn come back and make this central model better.”
Peter ChenJan 24, 2024▶ 19:17No Priors Ep. 48 | With Covariant CEO Peter Chen
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 100 episodes transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.
