Everything Chelsea Finn said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Finn: Humanoids are overrated because collecting teleoperation data is too difficult
“On the other hand, I think that they're a little overrated, and one way it kind of to practically look at it is, I think that we're generally fairly bottlenecked on data right now, and some people argue that with humanoids, you can maybe collect data more easi…”
Finn: Generalist robotics models may outperform purpose-built models
“And we think that this sort of generalist model may work better and be easier to use than purpose-built models, just like we've seen in the development of foundation, foundation models for language and other applications.”
Finn: Scale is necessary but not sufficient for open-world robotics models
“And so I think the lesson here is that scale is necessary for developing these models that can generalize in open world conditions, but they're subordinate to actually solving the problem. So you need scale, but it's not sufficient for the entire problem.”
Finn: Diverse Home Training Matches Custom Target-Environment Performance
“And we find that if we actually increase the amount of homes, the amount of locations that are represented in the data, The performance increases, which is great. And it actually gets to the same level of performance as if we train on data from that target env…”
Finn: Frontier models struggle with visual understanding for robotics
“In general, we found that these frontier models generally struggle with visual understanding as it pertains to robotics. Which makes sense because in general, these models aren't kind of really targeting, ah, many physical applications and have very little dat…”
Chelsea Finn: Real robot data cannot be replaced by synthetic data
“I think that at the end of the day, there's going to be no replacement for real data. And so we're like large amounts of real robot data. It's going to be a necessary component of any like system that's going to work in a generalizable way.”
Finn: Robot training data transfers across different physical hardware embodiments
“We've seen a lot of evidence that you could actually transfer a lot of rich information across these different embodiments and allows you to use data. And also if you iterate on your robot platform, you don't have to throw all your data away.”
Finn: Biggest risk in generalist robotics is technical failure, not competition
“The last thing that I'll mention is that I think the biggest risk with this bet is that it won't work. Like, I'm not really worried about competitors. I'm more worried that no one will solve the problem.”
Finn: Wrist-mounted RGB cameras capture much of what tactile sensors provide
“And we found that actually that mounting RGB cameras to the wrists ends up being very, very helpful and probably giving you a lot of the same information that tactile sensors can give you.”
Finn: Physical Intelligence is building a general-purpose model for all robots
“And in particular, we're trying to develop a general purpose model that can enable any robot to do any task in any environment.”
Finn: Human video data is constrained by robot-human embodiment gaps
“Alternatively, maybe we look at data from YouTube, which has also a massive data source and many videos of humans doing tasks that can be useful for training robots. But at the same time, we don't learn how to write by watching other people write, and we don't…”
Finn: Pre-training and curated fine-tuning unlocked robotic laundry folding
“And this was actually to take some inspiration from the world of language modeling to actually instead of just training a policy on all of our data, can we pre-train on all the data? And then fine tune on a highly, on a curated, consistent, high quality set of…”
Finn: Physical Intelligence adapted its model to an unseen third-party robot
“We're also able to apply that same recipe to robots at other companies. This is a robot that I've actually never seen in person before. They collected data. They sent the data to us. We fine tuned our model on their data. We actually didn't even know exactly h…”
Finn: Full Pre-Training Mixture Boosts Robot Performance Over 20% in Novel Homes
“And we find that these kind of bars on the right, which are excluding data from static robots in labs and environments and so forth reduces performance significantly. So the performance goes down to less than 60% when you exclude that data when evaluated in no…”
Chelsea Finn: Synthetic data's robotic analog is RL, not simulation
“I think that the analog of synthetic data in language models is actually not necessarily simulation in robotics, but closer to something like reinforcement learning.”
Finn: Pre-trained VLMs let robots perform tasks with unseen internet concepts
“We had a research result
a couple years ago where we showed that if you leverage vision language models, then you could actually get the robot to do tasks that require concepts that were never in the robot's training data, but were in the internet.”
Finn: Embodied AI and motor control are underrated compared to language models
“I feel like actually people underestimate how much intelligence goes into motor control. Many, many years of evolution is what led to us being able to use our hands the way that we do. And there are many animals that they can't do it even though they had so mu…”
Finn: General multi-robot models outperformed research labs' custom single-robot policies
“We actually found that we could take a checkpoint, send that model checkpoint to another lab halfway across the country, and the grad student at that lab could run the checkpoint on the robot, and it would actually More often than not do better than the model …”
Finn: Physical Intelligence's current state-of-the-art robot policies operate entirely without memory
“The other thing that I'll mention is actually right now we're most like, our policies right now do not have any memory. They only look at the current image frame. They can't remember even half a second prior.”
Chelsea Finn: Observational video alone cannot train robot foundation models
“I think that data can have a lot of value, but I think that by itself, it won't get you very far and I think that there's actually some really nice analogies you can make where for example, if you watch, like, an Olympic swimmer, swimmer race even if you had t…”
Finn predicts a 'Cambrian explosion' of diverse robot hardware platforms
“I don't know exactly, but I think that my bet would be on something where there's actually a
A really wide range of different robot platforms.
I think Sergei my co-founder likes to call it a Cambrian explosion of different robot hardware types and so forth.
O…”
Finn: Solving robotics applications traditionally requires building separate companies from scratch
“If you want to truly solve a robotics application, you essentially need to build an entire company around that application. Ah, you need to build a different company for logistics, for wet lab automation, For robots and kitchens, for surgical robots, and so on…”
Finn: Industrial automation data lacks behavioral diversity for general robotics
“So for example, we might look at data from industrial automation and you get tons and tons of data of robots doing tasks over and over again like this, but the sort of data isn't going to allow robots to go into disaster zones or to make a sandwich or to bag g…”
Finn: Current Robot Datasets Are Minuscule Compared to Future Scale
“I should mention this is large scale by today's robot standards and arguably a minuscule amount of data compared to the sorts of robot data that we should have in the years to come.”