General Intuition

“What world models do is they actually have to understand the full range of possibilities and outcomes from the current states and based on the action that you take generates the next states, right? So the next frame. And so it is a much more sort of complex pr…”

“This is just a base model. There's no RL, no fine tuning. This model sees no game states. It is purely capable, not sequence acceptance. It's purely predicting the actions from the phrase. That's it.”

“The baseline of our data set is PQ and performance.”

“We transferred it over to a real world video, which means that you can use any video on the internet as free training.”

“We made the decision to Pre-trained world models from scratch, but also we've actually been able to fine tune open source video models to get a better sense of physical transfer.”

“Our world models have mouse sensitivity, which is something that, like, gamers absolutely want, right? So you can have these, like, very rapid movements, which you couldn't do in any other world model.”

“When you're playing video games, you're actually simulating the optical dynamics with your hand, right? And I think that, like, that's why I think why games are a better representation of switch support reasoning initially than YouTube videos, for instance.”

“We have sort of the largest data set of ground truth action labeled video footage on the internet by maybe one or two orders of magnitude.”

“We had thousands of humans label every single action you can take in every single video game over the past year and a half which is an enormous amount of action labels.”

“So I think we're going to start with anything you can control using a game controller. But yeah, long term, we want to actually predict maybe like action embeddings and have models sit inside a general action space to be able to transfer out to other inputs as…”

“Anthony Tu, who led the research on Gaia II is, is also one of the engineers that joined our team. So it's all the Diamond the core contributors for Diamond, and then Anthony and we just had three more researchers joining this week.”

“I think our models will initially be used as like you'll have like an orchestrator VLM of sorts. That's kind of like managing instances and instructing them.”

“He asked you to, like, draw a twenty-thirty picture of your company, and I think he just picks And plus five years. Whatever. I don't know. I did the same to you. Yeah. He asks you to like walk that back from first principles all the way from today. And he ask…”

“And so I think for us, it is more so about making a maximal bet on video transfer and interacting with things that are difficult to simulate. And the steerability is also really interesting with text than it is on betting against simulation or something like t…”

“Honestly, Jan's podcast that he did, I don't remember which one it was, but a long time ago, where he basically proclaimed LLMs to be a dead end it was one of the things that inspired me to do this.”

“The way I think about it is, at Siemens, right, we had sort of a three-dimensional world, then we invented text. As like a, in a way, a compression method, right? So you had, we invented text in order to communicate with each other in a common way, in a way th…”

“Our business model is initially going to be an API, again, like the Anthropic API”

“Actually making every single clip on the platform playable at billions of clips scale is how we go from imitation learning to RL.”

“Because we have such a large data mode, we don't have to be as concerned as the LLM companies about publishing, because we don't need the ones to be able to. Exactly. No one can replicate the models, right?”

“We just announced our partnership with Qtai in France, which is an open science lab in Paris, one of the best research labs in the world. Eric Schmidt, I believe funded in addition to some French people. They are essentially acting as the partner that's curren…”

“In the atoms to atoms stage, I want, like, I want GI models to be responsible for 80% of all the atoms to atoms interactions driven by AI models and the reason for that is because we were able to unblock intelligence so quickly, and robotics, like, intelligenc…”