Hausman: End-to-end learning is the only viable path to solve robotics
Karol Hausman · The Race to Create General-Purpose Robots | Karol Hausman & Lachy Groom on TBPN · Apr 26, 2025 · at 16:43
Karol Hausman, co-founder of Physical Intelligence, contrasts deterministic C++ control systems with end-to-end neural network approaches in robotics.
0:00 / 0:05exact quote · 5.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“There's another reason to do end-to-end learning, which is, this is, I think, the only thing that has a chance of working.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Karol Hausman
Hausman: Most future frontier AI models will train on real-world robot data
“So I think over time, it's quite likely that, that the places are gonna switch a little bit, where most of the models, including, you know, LLMs and BLMs, are gonna be using real-world data collected through robots, because that's the data that has no ceiling,…”
Hausman: Simulation fails for robotic manipulation due to real-world object diversity
“It hasn't worked nearly as well for manipulating objects or working with your hands, and I think the reason for that is then the difficulty isn't about, like, how do you move your hands? It's more about the world that you're manipulating, and that is much hard…”
Hausman: Robot models require surprisingly few environments to generalize to new ones
“So far we've been quite surprised by how few different environments you need to see to be able to generalize to a new one.”
Hausman: Physical Intelligence models give robots zero-shot intuition in new environments
“And one thing with Pi-O-V that we are really excited about is that we are now at the stage where the robots kind of get the sense of what they should be doing in that environment. So, they are no longer in this space where, you know, you just, like, arrive in …”
Hausman: Physical Intelligence's robot demonstrations are fully end-to-end
“So end-to-end robotics is already here. Everything we've shown so far is fully end-to-end where you take camera input in and view other sensors and output actions directly.”
Hausman: Physical Intelligence demonstrated previously impossible tasks like laundry folding
“The demonstrations that we, that we've shown so far here at physical intelligence are of tasks that were not possible before, like things like folding laundry. You can't really, there is no program that I've ever seen that could do that.”