The Ledger, every show

“And this is a really fundamental primitive that we think is super exciting, a super new primitive For base models that no one's ever done before, right?”

“Like, if you look at the numbers, like, even going from Hopper to Blackwell, like, the performance per watt is about the same. They mostly make the number of transistors go up, and they make the chip size go up, and they make the power usage go up. But even fr…”

“Modeling the two D projections of a dynamic three D world is, is a function that probably can be modeled, but by putting a three D representation into the heart of a model, there's just going to be a better fit between the kind of representation that the model…”

“If you've got the ability to seamlessly blend virtual content with the physical world, it kind of deprecates the need for all of those.”

“Atlas is our new next generation world model. It has three basic things. It can generate, reconstruct, and simulate the world.”

“But now with Atlas, we can do this with just as few, through three cameras. So like no studio capture, no green screen, no expensive calibration. We can literally stick like three cameras on tri, three iPhones on tripods use these to take sort of a video of so…”

“You can input one or multiple up to a hundred frames that are views of the real world, and use those to reconstruct the real world, and that reconstruction can take the case either of a novel, a video flying through the space, or an explicit three-D reconstruc…”

“It also works on camera poses as a native input to the model, which I don't think anyone's ever done at the pre-training phase before.”

“Each time we made the model bigger and each time we trained it for longer, each time we put it on more chips, like it got significantly better.”

“Like five or 10 years ago, you really could train state-of-the-art models in the lab even with just a couple of GPUs. But, you know, because that technology was so successful and scaled up so much, then you can't train state-of-the-art models with a couple of …”

“Gaussian splats are really cool because you can render them in real time really efficiently. So you can render on your iPhone, render, render everything. And that's how we get that sort of precise camera control because The splats can be rendered real time on …”

“In 2020, you asked about breakthrough moments. There was a really big breakthrough moment from our co-founder Ben Mildenhall at the time with his paper, NERF neural radiance fields. And that was a very simple, very clear way of backing out three D structure fr…”

“And if you think about, you know, AlexNet required this jump from CPUs to GPUs, but even from AlexNet to today, we're getting about a thousand times more performance per card than we had in AlexNet days. And now it's common to train models, not just on one GPU…”

“So I ran the numbers last night, like that two week training run, that of six days on two GTX five eighties, if you scale, it comes out to just under five minutes on a single GB 200.”

“Because we already have the ability to create virtual interactive worlds but it costs hundreds and hundreds of millions of dollars and a ton of development time.”

“That AlexNet was a sixty million parameter deep neural network and it was trained for six days on two GTX five eighties, which was the top consumer card at the time, which came out in 2010.”