The Ledger

Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.

clear all ✕

why aren't all 11 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable

Insight
Song: Strict Physics Simulation Cannot Solve Fictional or Artistic Video Generation
“If we were trying to reason about the world via the traditional kind of physics techniques, it is very difficult to kind of reason about things inside a totally fictional world. So I think this is something that more happens like inside our dreams rather than …”
Jiaming Song Sep 9, 2024 ▶ 25:42 Luma's Dream Machine and Reasoning in Video Models
Assertion Partly supported
Song: Dream Machine Spontaneously Generates Consistent Cinematic Cuts Without Prompting
“Even though we haven't really asked the model to do anything about it, the model is able to reason about the second shot being a cut of the first shot that happens to have the same things in the first shot. So this is curse definitely some kind of a non-trivia…”
Jiaming Song Sep 9, 2024 ▶ 21:41 Luma's Dream Machine and Reasoning in Video Models
Disclosure
Song: Dream Machine Learned Physical Simulation and Lighting Without 3D Priors
“But what's really surprising about Dream Machine is that we almost did nothing with regards to these NERF datasets or have zero, three D priors into how the model works. But the model just by itself learns to kind of uncover these interesting physical aspects …”
Jiaming Song Sep 9, 2024 ▶ 12:28 Luma's Dream Machine and Reasoning in Video Models
Insight
Song: Video AI Models Learn Psychological Causality Beyond Basic Physics
“And this is possibly caused by this eye being very unnaturally looking, and this is some kind of a cause and effect that is, like, even harder to reason, like, strictly in the physics, but more delving into how just human psychology works. So I think the causa…”
Jiaming Song Sep 9, 2024 ▶ 22:41 Luma's Dream Machine and Reasoning in Video Models
Assertion Not checkable as stated
Song: Video Models Unexpectedly Learn 3D Spatial Reasoning From Raw Video
“It turns out from these type of videos, we are able to show that a video model is able to reason about three D quite well, which in some sense is unexpected before in, in the community.”
Jiaming Song Sep 9, 2024 ▶ 5:04 Luma's Dream Machine and Reasoning in Video Models
Insight
Song: 2D Image Models Cannot Reason About Camera Physics or Motion
“The limitations of images was that it wasn't able to reason about how You know, the camera works in the world because it only has like a relatively independent shots of different objects.”
Jiaming Song Sep 9, 2024 ▶ 4:24 Luma's Dream Machine and Reasoning in Video Models
Assertion Not checkable as stated
Song: Dream Machine Surpasses Multi-View Image Models in Detail and Resolution
“So I think that tells me that Dream Machine is definitely able to reason about better than any of the models that we've, you know, worked with before, and this is very much unlike, like, even the models that you try to obtain by fine-tuning on the, you know, l…”
Jiaming Song Sep 9, 2024 ▶ 7:01 Luma's Dream Machine and Reasoning in Video Models
Assertion Not checkable as stated
Song: Dream Machine Video Outputs Enable Consistent 3D Scene Reconstruction
“For example, in this case, what we do is we literally took one of the videos from the last side and we put this video into our three D reconstruction pipeline. And it turns out that it is able to reconstruct a three D scene at this direction quite reasonably w…”
Jiaming Song Sep 9, 2024 ▶ 6:01 Luma's Dream Machine and Reasoning in Video Models
Assertion Not checkable as stated
Song: Dream Machine Synthesizes 3D-Consistent Video From Single NeRF Frames
“We put the first frame of an image into Dream Machine, and then Dream Machine will give us the output as a video. So as you can see here, like, the three-d consistency of the generated video looks quite amazing”
Jiaming Song Sep 9, 2024 ▶ 9:02 Luma's Dream Machine and Reasoning in Video Models
Assertion Not checkable as stated
Song: Current Text-to-Video AI Models Are Only at a Version Zero Stage
“Currently. No, we are only at a very, very you know, basic stage at, you know, being able to like generate videos from text and images at this stage. I will say this is more like a, as you said, research preview or version zero of the model.”
Jiaming Song Sep 9, 2024 ▶ 28:48 Luma's Dream Machine and Reasoning in Video Models
Assertion Supported
Song: Dream Machine Reasons About Artistic and Non-Physical Video Scenes
“So I think the other interesting thing that we showed a slightly earlier, but also want to kind of reemphasize here is how dream machine is able to reason about the non-physical world as well. Even in cases where it's in entirely a scene of art, it is able to,…”
Jiaming Song Sep 9, 2024 ▶ 25:16 Luma's Dream Machine and Reasoning in Video Models
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.