Dream Machine
8 statements across 1 episodes · 8 bullish · 0 bearish · 1 people on the record · first statement Sep 9, 2024 by Jiaming Song · said 28 times in 1 episodes since 2024 · across every show →
Mentions by year
brought up most by Anjney Midha (17), Jiaming Song (11)
tap a year for its mentions
2024 28 mentions in 1 episode
Everything said about Dream Machine, oldest first
Sep 9, 2024 positive
Song: Dream Machine Spontaneously Generates Consistent Cinematic Cuts Without Prompting
“Even though we haven't really asked the model to do anything about it, the model is able to reason about the second shot being a cut of the first shot that happens to have the same things in the first shot. So this is curse definitely some kind of a non-trivia…”
Sep 9, 2024 positive
Song: Dream Machine Surpasses Multi-View Image Models in Detail and Resolution
“So I think that tells me that Dream Machine is definitely able to reason about better than any of the models that we've, you know, worked with before, and this is very much unlike, like, even the models that you try to obtain by fine-tuning on the, you know, l…”
Sep 9, 2024 positive
Song: Dream Machine Simulates Complex Metallic Reflections From a Single Photo
“With Dream Machine, we just took another coffee machine that we have in the office, and then just do image to video, and we can actually see a lot of the light reflections On top of the metal surface of the coffee machine being simulated by the model.”
Sep 9, 2024 positive
Song: Dream Machine Video Outputs Enable Consistent 3D Scene Reconstruction
“For example, in this case, what we do is we literally took one of the videos from the last side and we put this video into our three D reconstruction pipeline. And it turns out that it is able to reconstruct a three D scene at this direction quite reasonably w…”
Sep 9, 2024 positive
Song: Video AI Models Learn Psychological Causality Beyond Basic Physics
“And this is possibly caused by this eye being very unnaturally looking, and this is some kind of a cause and effect that is, like, even harder to reason, like, strictly in the physics, but more delving into how just human psychology works. So I think the causa…”
Sep 9, 2024 positive
Sep 9, 2024 positive
Song: Dream Machine Reasons About Artistic and Non-Physical Video Scenes
“So I think the other interesting thing that we showed a slightly earlier, but also want to kind of reemphasize here is how dream machine is able to reason about the non-physical world as well. Even in cases where it's in entirely a scene of art, it is able to,…”
Sep 9, 2024 bullish
Song: Dream Machine Learned Physical Simulation and Lighting Without 3D Priors
“But what's really surprising about Dream Machine is that we almost did nothing with regards to these NERF datasets or have zero, three D priors into how the model works. But the model just by itself learns to kind of uncover these interesting physical aspects …”