Karol Hausman, co-founder of Physical Intelligence, discusses the performance benchmarks of their newly released foundation model, Pi-05.
Opinion
Hausman: End-to-end learning is the only viable path to solve robotics
“There's another reason to do end-to-end learning, which is, this is, I think, the only thing that has a chance of working.”
Prediction Open · timeframe Apr 2030
Hausman: Most future frontier AI models will train on real-world robot data
“So I think over time, it's quite likely that, that the places are gonna switch a little bit, where most of the models, including, you know, LLMs and BLMs, are gonna be using real-world data collected through robots, because that's the data that has no ceiling,…”
Insight
Hausman: Simulation fails for robotic manipulation due to real-world object diversity
“It hasn't worked nearly as well for manipulating objects or working with your hands, and I think the reason for that is then the difficulty isn't about, like, how do you move your hands? It's more about the world that you're manipulating, and that is much hard…”
Insight
Hausman: Robot models require surprisingly few environments to generalize to new ones
“So far we've been quite surprised by how few different environments you need to see to be able to generalize to a new one.”
Assertion Not checkable as stated
Hausman: Physical Intelligence models give robots zero-shot intuition in new environments
“And one thing with Pi-O-V that we are really excited about is that we are now at the stage where the robots kind of get the sense of what they should be doing in that environment. So, they are no longer in this space where, you know, you just, like, arrive in …”
Disclosure
Hausman: Physical Intelligence's robot demonstrations are fully end-to-end
“So end-to-end robotics is already here. Everything we've shown so far is fully end-to-end where you take camera input in and view other sensors and output actions directly.”