Levine: In Robotics, Common Sense Is the Opposite of Muscle Memory
Sergey Levine · World's Top Researcher on AI, LLMs, and Robot Intelligence · Invest Like The Best · Mar 31, 2026 · at 26:07
Sergey Levine, co-founder of Physical Intelligence and UC Berkeley professor, explains how robotic systems apply cross-domain semantic knowledge to physical tasks.
0:00 / 0:47exact quote · 47.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“For the purpose of robotic learning, ah, we can think of it as applying semantic inferences Using knowledge learned from other domains to a, to the current physical task at hand, right? So you can think of common sense as sort of the opposite of muscle memory. So muscle memory, like if you play a sport, you practice something a lot, you hardly think about it. You just kind of do it on autopilot. Common sense, in my mind, I don't know if this is the conventional definition, but I think it's a reasonable definition, is when you know something to be true because You saw it, or you read about it, or you heard it, and now you are in a situation where that fact is highly pertinent to what you need to do, and you are able to make that connection, apply it to your situation, ground it in the environment that you're in, and make the right decision.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sergey Levine
Levine: General Robotics Models May Ultimately Be Easier Than Narrow Ones
“And part of the thesis of this company is that we believe that doing it at the full level of generality might actually in the long run be easier than trying to special case very specific narrow application domains.”
Levine: Multi-robot data will enable foundational physical models for rapid deployment
“So if we can draw on data from many sources, many applications, many robots, then we can have a model that has a physical understanding, and it'll be much, much easier to put new applications on top of that platform.”
Levine: Future Robots Won't Just Be Humanoid 'Metal People'
“And I think, you know, we, sometimes we think that, like, robots are going to be, like, one thing. Like, it's just like, you know, there's people, and now we're going to make, like, metal people, and that'll be, like, robots. But I don't think that's how it's …”
Levine: Robotic foundation models will adapt across diverse physical form factors
“And I think that in the future we'll have A robotic foundation model, which can then be adapted to all sorts of applications, and they might really run the gamut from like, you know, like bulldozers or something, to humanoids, to robotic arms like this thing, …”
Levine: Chain-of-thought reasoning allows robots to handle edge cases
“So the way you get common sense is by essentially using chain of thought. So the robot enters a scene and instead of directly starting to move, it thinks about what it was asked to do. So if it was told to clean up the kitchen, looks at the scene and says, lik…”