Dream Machine, every mention

Luma's Dream Machine and Reasoning in Video Models Sep 9, 2024 · 28 mentions

• ▶ 0:18 Anjney Midha So what is Dream Machine? 3 times in the scene
• ▶ 0:46 Anjney Midha Because that's really the first research and product milestone that, that led to the development ultimately of dream machine.
• ▶ 5:45 Anjney Midha So just to, just so I'm playing this back correctly, you're saying when, what we're looking at here is a few samples of Luma Dream Machine generations.
• ▶ 6:44 Anjney Midha That image then became the prompt for the Dream Machine video model.
• ▶ 6:59 Anjney Midha What does that tell you about what Dream Machine is doing? 3 times in the scene
• ▶ 9:02 Jiaming Song These are some videos on, that we tried on some, like, Nerf datasets, and actually because a lot of us work on Nerf, like, Gaussian splatting and reconstruction, so the context here is that we put the first frame of an image into Dream…
• ▶ 11:42 Jiaming Song Video generated by dream machine where the input is a image frame. 2 times in the scene
• ▶ 13:39 Anjney Midha You're saying a single image was passed through the Dream Machine as a prompt. 4 times in the scene
• ▶ 17:35 Jiaming Song With Dream Machine, we just took another coffee machine that we have in the office, and then just do image to video, and we can actually see a lot of the light reflections
• ▶ 19:31 Anjney Midha You kind of want to understand and see evidence that dream machine, if it's actually doing more than just generating cool frames, it, it ideally should be able to start predicting what changes in the world must come, must happen.
• ▶ 22:11 Jiaming Song Contains what we wanted to give to the dream machine. 5 times in the scene
• ▶ 23:48 Anjney Midha Basically, there's a representation of reality that the Luma Dream Machine model is exposing that is able to maintain semantic consistency about what should happen in the world. 2 times in the scene
• ▶ 25:16 Jiaming Song So I think the other interesting thing that we showed a slightly earlier, but also want to kind of reemphasize here is how dream machine is able to reason about the non-physical world as well. 2 times in the scene
• ▶ 26:48 Anjney Midha And what have you, what are your conclusions from seeing all the sort of emergent properties of reality that Dream Machine can simulate?