world models

“So I think this is not going to be solved in my opinion by you know, more tweaks on the architectures and more training data and things like this. I mean, it may be mitigated, but I think it's not going to be fixed by that. I think it's going to be fixed by sy…”

“We've done a ton of work on AI on the platform over the last few years. That was what I would call more narrow specialized models. We can continue to do that, but the bigger step change are gonna come through the more general model, building foundation models,…”

“So I think that's the next big step actually for agent based systems is to go beyond world models. Can you collect enough data where the agents are also acting in the world and making plans and achieving tasks? And I think for that you will need Ah, ah, not ju…”

“Even if you only have a one percent error in what the model's telling you, that's going to compound over a hundred steps to the point where you'll be in a, you know, you'll kind of get almost a random answer. And so that makes the planning very difficult.”

“Is the right way to approach this problem to train better and better video generation systems? And my answer to this is absolutely no. The problem of understanding the world does not go through the solution to the, to generating video at the pixel level.”

“So I think the very description of LLM Needs to change. In fact, I think now we're talking about world models. I think world models are a more accurate description of what we're talking about.”

“And then, of course, that would be, I think, essential for a GI, because that would allow these systems to plan, long-term plan, in the real world over, perhaps, very long time horizons, which, of course, we as humans can do, you know I'll spend four years get…”

“World models are absolutely essential when you want to build agents, because these agents are going to take actions, which is going to change the world. You want to be able to predict these effects.”

“The model alone, the foundation model alone, is, is not an AGI. No, you need the other guy, which uses all kinds of tricks to exploit The algorithmic information in the world model to come up with better plans.”

“Whenever the agent is, is making plans like that, it's thinking about itself, waking up these internal representations of itself, and then it's self-aware.”