robotics

“So it turns out that when it comes to arbitrary objects current robots are unable to just grasp an arbitrary object. For any object, it's possible to hand-code a single solution, so, say, as long as, let's say, in factory, if you have same object like I don't …”

“So in terms of robotics, we are working on manipulation. We think that manipulation is the complete, it's the one of the parts of robotics, which is the most unresolved.”

“There's also one really cool interface between VR and AI that's happening right now, where the whole idea is, like there's a project called Universe from OpenAI, and another project called DeepMindLab, which basically, like, imagine you need to teach a robot t…”

“Building shitty robots was this like way of approaching a very intimidating field, which is robotics that I was really interested in, but I haven't gone to school for. And I was like, oh, if I only try to build shitty things and nobody can like make a joke on …”

“Robotics companies now are where, you know, LLM companies were five years ago. So I think in five years, you know, or even, even sometime in the next five years, we will see the chat GPT moment for robotics.”

“And, you know, like, AI and robotics does give us a new possibility of a way to bring manufacturing back here and to bring sort of these complex industries here in a really important new way. And I would say that's at least worth trying.”

“It's going to be challenging to collect a large number of human robot interactions with the real robot in the loop. And this is also going to be fairly hard to scale.”

“So for example, we might look at data from industrial automation and you get tons and tons of data of robots doing tasks over and over again like this, but the sort of data isn't going to allow robots to go into disaster zones or to make a sandwich or to bag g…”

“In general, we found that these frontier models generally struggle with visual understanding as it pertains to robotics. Which makes sense because in general, these models aren't kind of really targeting, ah, many physical applications and have very little dat…”

“And I think a lot of things actually, like TSMC, like ASML, those are hard problems that eventually will get easy with robotics, et cetera, but robotics are lagging behind. So I think there's these hard problems that will exist even in two years, and if you're…”

“That was a big paper, because it was the first that showed potential scaling laws that applied to robotics, because now you could start training all these models across multiple kinds of hardware, not just one, which has never been done in robotics ever before…”

“I think this is another area of incredible opportunity of kind of building services for robot company. Like, you know, if you can offer remote tele-op, for example, if you can offer data collections, if you can offer annotation service, because, you know, thes…”

“I think the first is Seikan, which to me was the first demonstration of language model and how you can bring all of the common sense knowledge in language model into robotics, and therefore that significantly kind of reduces the need to collect robot-specific …”

“Our mission is to build a model that can control any robot, to do any task that is physically capable of, and to do so as such a high level of performance that's going to be useful to people in all walks of life.”

“He's one of the co-founders of Physical Intelligence, which we think might be the robotics AI lab that brings about the GPT-I moment for all of robotics.”

“I would say the chat GPT moment of robots happened a couple of years ago already.”

“Almost right away, we started working on computer vision. Almost right away, we started working on robotics self-driving cars”