Karol Hausman, co-founder and CEO of Physical Intelligence, discusses findings from developing their robot foundation model Pi-05 regarding training environment diversity.
Opinion
Hausman: End-to-end learning is the only viable path to solve robotics
“There's another reason to do end-to-end learning, which is, this is, I think, the only thing that has a chance of working.”
Prediction Open · timeframe Apr 2030
Hausman: Most future frontier AI models will train on real-world robot data
“So I think over time, it's quite likely that, that the places are gonna switch a little bit, where most of the models, including, you know, LLMs and BLMs, are gonna be using real-world data collected through robots, because that's the data that has no ceiling,…”
Insight
Hausman: Simulation fails for robotic manipulation due to real-world object diversity
“It hasn't worked nearly as well for manipulating objects or working with your hands, and I think the reason for that is then the difficulty isn't about, like, how do you move your hands? It's more about the world that you're manipulating, and that is much hard…”
Assertion Not checkable as stated
Hausman: Physical Intelligence models give robots zero-shot intuition in new environments
“And one thing with Pi-O-V that we are really excited about is that we are now at the stage where the robots kind of get the sense of what they should be doing in that environment. So, they are no longer in this space where, you know, you just, like, arrive in …”
Disclosure
Hausman: Physical Intelligence's robot demonstrations are fully end-to-end
“So end-to-end robotics is already here. Everything we've shown so far is fully end-to-end where you take camera input in and view other sensors and output actions directly.”
Assertion Not checkable as stated
Hausman: Physical Intelligence demonstrated previously impossible tasks like laundry folding
“The demonstrations that we, that we've shown so far here at physical intelligence are of tasks that were not possible before, like things like folding laundry. You can't really, there is no program that I've ever seen that could do that.”