Fruchter: Genie 3 generates environments without explicit 3D representations
Shlomi Fruchter · Google DeepMind Lead Researchers on Genie 3 & the Future of World-Building · Aug 16, 2025 · at 11:33
Shlomi Fruchter, Research Director at Google DeepMind, explains the architectural choice behind Genie 3's persistent spatial memory during an interview on The a16z Podcast.
0:00 / 0:47exact quote · 47.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“One thing that we didn't want to do, and we didn't want to build an explicit representation, right? So there are definitely methods that are able to achieve consistency, and they did that through an explicit, some three, you know, their nerves, and other methods that basically say, okay, if we know how the world looks like, we use this kind of like, Prior assumptions on how the word remains static pretty much, then we can build representation, and then what you're looking at. So that's great, I think, for some applications, but we didn't want to go down this path because we felt it's somewhat limiting, and I think so we can definitely say that the model doesn't do that and it does generate, like, frame by frame, and we think this was, this is really key for the generalization to actually work.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Shlomi Fruchter
Fruchter: Genie 3 is a research preview, not a commercial product
“Gini Free is pretty much a research preview, right? It's not something we are releasing at this point.”
Fruchter: Current world models remain far from accurately simulating reality
“I think they are very far from actually simulating the world accurately and being able to do, to kind of put a person in there and then do whatever they want.”
Fruchter: DeepMind achieved real-time interactive environment generation
“We weren't sure, like, how, how big it's gonna be but we definitely felt, I felt definitely that we have something that was kind of like for a long time coming, basically being able to generate environments in real time. I think a lot of work that was done in,…”
Fruchter: Genie 3 currently caps spatial memory retention at one minute
“There was not like, there is no like fundamental limitation, but Currently the current design we limited to one minute of this type of memories.”