Battaglia: Data pipelines matter more than neural network architectures today
Peter Battaglia · How AI is changing weather forecasting · Jan 2, 2026 · at 25:22
Peter Battaglia of Google DeepMind explains why data processing and training methods have eclipsed novel model architectures in AI advancement.
0:00 / 0:10exact quote · 10.9s
720p mp4 · rendered on demand · StarZero watermark
“I don't feel that neural network architectures these days tend to be the sort of exciting part. It's usually more of like the training and the sort of data how you handle the data and that kind of thing.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Peter Battaglia
DeepMind uses transformers to model spatial interactions in weather, not time
“We actually use transformers not to model the spatial, the interactions in weather over time, like the sequence of text, but in space.”
Battaglia: AI weather models leverage macroscopic spatial ranges unlike traditional simulations
“In a traditional model, the way it simulates that is it, in very fine detail, it kind of figures out, like, what's the pressure, and the temperature, and the wind, and the moisture, and what are those things? What's going to happen next is determined strictly …”
DeepMind primarily uses traditional supervised learning for AI weather models
“What we use in our weather forecasting models, and a lot of folks out in the community are using it as, you know, as this field is advancing and this AI-based weather forecasting is developing, we're still mostly using fairly traditional machine learning, supe…”
Battaglia: Early ML in weather improved downstream calibration, not base models
“So actually, the first advent of like, AI and machine learning in weather forecasting, or at least some of the earliest, was not, like, trying to overhaul the whole weather forecast process itself, but making, you know, using more and more, like, statistical m…”
Battaglia: Precipitation and wind are harder to forecast due to fine-scale dynamics
“So that type of very high resolution, complex, you know, patterns of precipitation, for example, Wind as well. Those are much harder to predict because you're effectively predicting a lot more information. You can't just sort of summarize it by saying, oh, eve…”