Song: Dream Machine Video Outputs Enable Consistent 3D Scene Reconstruction
“For example, in this case, what we do is we literally took one of the videos from the last side and we put this video into our three D reconstruction pipeline. And it turns out that it is able to reconstruct a three D scene at this direction quite reasonably w…”
Song: Dream Machine Surpasses Multi-View Image Models in Detail and Resolution
“So I think that tells me that Dream Machine is definitely able to reason about better than any of the models that we've, you know, worked with before, and this is very much unlike, like, even the models that you try to obtain by fine-tuning on the, you know, l…”
Song: Dream Machine Synthesizes 3D-Consistent Video From Single NeRF Frames
“We put the first frame of an image into Dream Machine, and then Dream Machine will give us the output as a video. So as you can see here, like, the three-d consistency of the generated video looks quite amazing”
Song: Dream Machine Learned Physical Simulation and Lighting Without 3D Priors
“But what's really surprising about Dream Machine is that we almost did nothing with regards to these NERF datasets or have zero, three D priors into how the model works. But the model just by itself learns to kind of uncover these interesting physical aspects …”
Song: Dream Machine Simulates Complex Metallic Reflections From a Single Photo
“With Dream Machine, we just took another coffee machine that we have in the office, and then just do image to video, and we can actually see a lot of the light reflections On top of the metal surface of the coffee machine being simulated by the model.”
Song: Dream Machine Spontaneously Generates Consistent Cinematic Cuts Without Prompting
“Even though we haven't really asked the model to do anything about it, the model is able to reason about the second shot being a cut of the first shot that happens to have the same things in the first shot. So this is curse definitely some kind of a non-trivia…”
Song: Video AI Models Learn Psychological Causality Beyond Basic Physics
“And this is possibly caused by this eye being very unnaturally looking, and this is some kind of a cause and effect that is, like, even harder to reason, like, strictly in the physics, but more delving into how just human psychology works. So I think the causa…”
Song: Dream Machine Reasons About Artistic and Non-Physical Video Scenes
“So I think the other interesting thing that we showed a slightly earlier, but also want to kind of reemphasize here is how dream machine is able to reason about the non-physical world as well. Even in cases where it's in entirely a scene of art, it is able to,…”
Lütke: Tech History Books Will Be Seen as Mainline Human History
“I think in a 102 hundred years from now, when we talk about human history like, these books that, like, Hackers by Stephen Levy, and The Dream Machine, and like, Code by Petzold, and, you know, all these kind of, these books are actually going to be referenced…”