Everything Sergey Levine said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Levine: Foundation models will trigger a PC-like explosion in robotics applications
“And I think something like that might happen in the world of robotics, but it can't happen today because if you want to put together some cool new robotics applications, some cool new robotics idea, you kind of have to build this, like, monstrous stack, and yo…”
Levine: Future Surgical Robots Will Not Be Limited to Human Control
“I think that in the long run, this is not by any means a short term thing, but in the long run, I think there's lots of really exciting applications in medicine and surgery where we not only might in the long run not be limited to robots that look like humans,…”
Levine: General purpose robot models require far less data per task
“Being able to train general purpose models that can handle many tasks is essential to this because now you need a lot less data for each new task.”
Levine: Multimodal LLMs hold broad knowledge but lack physical grounding
“Multimodal language models are really good at pulling in knowledge and trying to articulate that knowledge. They're not very good at, like, grounding that knowledge in physical situations, but they know stuff.”
Levine: Deep RL Is Essential for Robots to Exceed Human Performance
“I think that the first deep reinforcement learning systems, which were in the early 20 tens, like those are probably a milestone because deep reinforcement learning gives us a way to go beyond human level performance, which I think will be essential for roboti…”
Levine: Adapting Multimodal LLMs to Robot Control Is a Key Advance
“I do think that the advent of Multimodal LLMs that can be adapted to robotic control to bring in that common sense. I do think that's a really important advance.”
Levine: GenAI Mimics Humans, But Deep RL Discovers Novel Solutions
“The generative AI is impressive because it can reproduce some of the things that humans can do. Like, it can draw pictures that look like people, you know, human pictures write text. Deep RL is impressive for the opposite reason. It does things that humans had…”
Levine: Robot Wrist Cameras Function as De Facto Touch Sensors
“The wrist cameras are essentially a touch sensor in disguise because you can see local deformations when you touch something.”
Levine: Scaling physical AI requires real-world data flywheels over fixed datasets
“So, I think that the key is not so much to quantify, like, here is exactly the price tag of getting the ultimate robot data set. The key is to get a system that can go into the world that's useful enough That does a wide variety of different things and they ca…”
Levine: Easy Data Collection Makes Physically Intricate Robotics Tasks Easy
“And I think increasingly what we'll see is a shift where domains where collecting data is straightforward
They actually end up falling into the easy bucket over time, even if they are physically intricate. But there will be domains where collecting data is dif…”
Levine: In Robotics, Common Sense Is the Opposite of Muscle Memory
“For the purpose of robotic learning, ah, we can think of it as applying semantic inferences Using knowledge learned from other domains to a, to the current physical task at hand, right? So you can think of common sense as sort of the opposite of muscle memory.…”
Levine: Handling unexpected home situations is robotics' biggest technical risk
“I think the place where I would see the biggest technical risk is dealing with the breadth of different situations. So, I think if we were talking about a well-defined, but, you know, But slightly chaotic environment like cleaning hotel rooms, or working, ah, …”
Levine: Acrobatic Humanoid Demos Rely on Simulation, Not Real-World Data
“If you've seen videos of humanoids doing all these acrobatics, right? There's a particular pipeline that makes that work, which is very heavily reliant on simulation, and actually very light on real world data, often almost, often actually zero real world data…”
Levine: Robots Surpass Human Speed by Editing Out Cognitive Pauses
“It turns out to be like pretty straightforward to go in and like find all those pauses and remove them. And you can speed things up further, so you can get a task where a person demonstrates what it means to succeed, and then you can have the robot practice th…”
Levine: Traditional control pipelines bottleneck robotic hardware innovation
“I think that in general, in robotics, the ability to innovate on form factors has been very constrained because of the AI challenge, right? So if you have a traditional AI pipeline, like, you know, you're doing some motion planning and stuff like that, It's ha…”
Levine: LLMs Show True Compositional Generalization Through IPA Paragraphs
“But if you ask a good language model, it will write paragraphs in IPA for you. And that is compositional generalization. It means that you have never seen this particular language, this particular alphabet, used to write paragraphs, but you understand paragrap…”
Levine: Changing a Child's Diaper Will Be Exceptionally Hard for Robots
“I think changing a child's diaper will be really, really hard.”
Levine: Physical intelligence underpins human reasoning from daily language to theoretical physics
“We, we're so primed to interact with the physical world, so primed to have physical intelligence that you can use it in everyday speech by saying that company has a lot of momentum, and you can use it when advancing fundamental theoretical physics.”
Levine: Foundation Models Reduce Uncertainty Before Scaling Robot Hardware Manufacturing
“So, yes, making a robot at scale is difficult. Making a robot at scale is even more difficult if you don't know what kind of software's gonna run it afterwards, and you're not even sure whether it's the right kind of robot. So, I think one of the really valuab…”
Levine: Robotics demos hold value when honestly tied to a mission
“I think that, you know, what I'll say in general terms is that I think it, there is a lot of value in demos that serve to illustrate challenges on the road to something useful and productive. And obviously you can also do a demo without being on the road to so…”
Levine: Robot Arm Costs Plummeted From $400,000 to $3,000 in a Decade
“When I started working in robotics about a decade ago, I worked with a robot called a PR-II, which I believe had a cost of about 400,000 dollars. When I started my lab at UC Berkeley, I used a robot that was in the ballpark of 30,000 dollars. Now, each arm on …”
Levine: Robotics Timelines Are Uncertain Due to Activation Energy Bottlenecks
“Where there's a bootstrap challenge, like getting to a particular level of usefulness so that, ah, robots can be deployed so they can do useful tasks, so they can start collecting data from open world settings at scale, and because that's such a, like a sudden…”
Levine: Most Deployed Industrial Robots Still Run 1980s Technology
“Most robots that are out there doing useful work are still running, you know, state-of-the-art technology from the 19 eighties.”
Levine: Physical Intelligence trained espresso-making robot using repeated RL practice
“And for example, we had this demo on, ah, making espresso. That system practiced making those espressos many, many times and used that to improve robustness, improve speed, improve throughput.”