Peter Ludwig

“Digital AI, of course, is building software and optimizing ads and creating videos. That's all interesting and good, but really where you talk about the global economy, that's physical AI.”

“And if you have perfect alignment between the real world and the world model, I mean, I think you've just sort of solved the universe roughly, right? That's an impossibly difficult problem. But as we make progress towards that it makes training physical AI mod…”

“I like to say that the labs, they have it easy because they can make models that are trillions of parameters, and those models can be super slow, and that's fine, but we don't have that luxury in physical AI, right? We deal in real time, like the actual, actua…”

“So we can have very large models, and we do have very large models that are used In the off-board environment. But when, once you go on board, all of those constraints are very real. And now we need to train a much smaller model that has these safety constrain…”

“This is speculation, but I think Grand Theft Auto VI will be perhaps the last major real-world video game that's still really developed, let's say, in that legacy era of traditional computer graphics tooling.”

“Are basically never doing updates and they're, and even if they are doing updates, they're usually only updating maybe one module. Maybe they're updating the HMI module, but they're not able to update, let's say the seafood critical parts of the system. You ha…”

“So physical machines today are more akin to the state of the phone market before Android and iOS existed.”

“Six months ago, I would have said the same thing, but it's becoming super useful for every domain. I'm sure. Right. Like there was I think six months ago, or maybe, maybe a year ago, if you tried to use, let's say the latest Claude model for writing shaders G…”

“I think this is probably the hardest problem right now because the, as the models get better, it can be harder, harder to find the faults on the system. And so like the problem of doing proper eval to find those faults like that problem also keeps getting hard…”

“And so to do reinforcement learning on an end to end model, you now need to actually simulate all the sensor data, right?”

“I think if you're hoping to do real world deploys and you're purely relying on a world model approach, you probably won't get to something that works before you go bankrupt.”

“The way to think about it, honestly, is a little bit like any system that you as an, as a human would need special training to operate. You can think of a little bit differently. So like the license to operate a truck is different from the license to operate a…”

“So the same operating system and platform Really runs across all of these vehicle types. So like literally on this tractor, and then over here, if you take a look there, this is actually we're showing re in real time. We have actual construction and mining equ…”

“So the future of mining and eventually construction is going to be these fully autonomous operations, where labor shortage is a real problem in the industry, and so this allows a very small number of people to control a huge number of vehicles.”

“This is our mobile command center, and so all of the development tools and infrastructure that we are typically able to use to build interesting defense technologies at, say, in an office environment, all of that is packaged up and can run completely offline, …”

“We have actual boats out in the ocean which we are remotely controlling and doing a patrol operation.”

“I think the, it's becoming a little bit less important now to be, let's say, a specialist software engineer in a given field, because The AI tools, they can turn you into a specialist much more quickly, but you need to be an expert in the AI tool use itself, a…”

“John Deere has had a production semi-autonomous tractor trailer system for harvesting crops for more than a decade.”

“And then the very last level is level five, which is more of an idea than a reality. It's the notion that there could be a vehicle that is, is able to drive autonomously in, in all conditions where a human would be able to operate that vehicle. And the truth i…”