Physics Simulation
topic on 2 shows · 4 statements across 4 episodes
4 statements about Physics Simulation, every show
Transformers will never scale to high-resolution 4D physics simulations
“So forget ever having a transformer for anything of this scale. All of the world's compute will not be enough. And first of all, they all have to be co-located to be able to ever do this. So that's why we need other architectures.”
Casado: Solving all math with AI won't predict everything in physics
“And then I read a lot of these discourses on the math solutions, and there's kind of these claims where if it can solve all math, you can predict anything. And I just think that that's a huge, huge logical leap, which is not clear to me that is, is, is, is, is…”
Edunov: Small molecules can be modeled with physics to generate training data
“In small molecular space, you can actually model your small molecules with physics. You can model their behavior, and that allows you to create more data that you can train model on. Something which is not necessarily possible in protein to protein.”
Physics simulation compute complexity scales rapidly with agents, freedoms, and information
“The compute complexity of simulation goes up really, really rapidly with three variables. First, the numbers of agents in an environment. Second they're DOF. So they're individuals of freedom. Yeah. And then third, the information that each action reveals.”