Sun: Moonlake will automatically generate training environments for embodied AI by 2029
Fan-yun Sun · Moonlake: Interactive, Multimodal World Models — with Chris Manning and Fan-yun Sun · Apr 2, 2026 · at 49:23
Moonlake co-founder Fan-yun Sun outlines the three-year roadmap for expanding Moonlake's world model from gaming into embodied robotics simulation.
0:00 / 0:59exact quote · 59.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I'll maybe start with where we see the platform in three years, which is like, okay, the users would tell us what they want to achieve. The end goal could be, hey, I just, I want to make something to teach my kids the value of humility. Or it could be, hey, I want to fine tune my drones to be really good at rescue situations. I could be, Vacuum robots. I want to like train my manipulation or like vacuum robot to be very robust to my office. Right. But it's like, whatever it is, like navigate very robustly within my office. But then it's like, whatever end goal that you want, our world model will say, okay, given what you want to achieve, let me generate a distribution of environments such that I can train and evaluate Whatever it is you want, right? Maybe for the purpose of games, it's just the end simulation and that's the end product. For certain policies, it's like, I can train within these environments and then help you see where your policy is failing or not.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Fan-yun Sun
Sun: Neural rendering with world priors will replace rasterizers and DLSS
“We actually believe that this is going to be the next paradigm of rendering. So it's going to replace how rasterizers, it's going to replace DLSS today because it not only has these pixel prior that's learned from the world, such that you can literally play an…”
Sun: Pixel-coherent world simulators are overrated for causal reasoning and embodied AI
“Having a world simulator that can produce pixel coherency is very, very useful for games and, you know, marketing and all these things, but it's not as useful as people think when it comes to causal reasoning, when it comes to embodied AI.”
Sun: Synthetic data matches real-world data for multimodal model pre-training
“We were actually generating a lot of synthetic data and showing that, hey, you can actually, these synthetic data are actually as useful as real-world data when it comes to multimodal pre-training.”
Sun: Embodied General Intelligence Requires Interactive Causal Data
“On our way to, let's call it embodied general intelligence, Models need to learn the consequences behind their actions, which means that they need interactive data.”
Sun: Using structural abstraction in AI does not contradict Bitter Lesson
“I do feel like sometimes people confuse like, oh, like we're taking an, a method with abstraction. That means they don't believe in bitter lesson. Like that's just false, right? Like we are believers in bitter lesson, but then I feel like the question that we …”
Sun: Moonlake splits world modeling into multimodal reasoning and Reverie rendering
“Within our world modeling framework, we think there are two models that we train, right? Like there's the multimodal reasoning model that we just talked about that essentially handles Mainly the causality, the persistency, and logic, determinism, determinism o…”