Mensch: AI pre-training saturates at 10^26 FLOPs due to data limits
Arthur Mensch · Who Wins if AI Models Commoditize? — With Mistral CEO Arthur Mensch · Jan 16, 2026 · at 26:08
Mistral AI CEO Arthur Mensch explains the technical dynamics limiting the scaling of frontier closed-source models.
0:00 / 0:14exact quote · 14.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Basically you have a saturation effect when you pre-train models around 10 to the power of 26 flops. The reason for that is that there's only that much data you can find to compress when you pre-train models.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Arthur Mensch
Mensch: AI competitors are investing billions in rapidly depreciating assets
“The challenge that we see with some of our competitors is that they're investing billions or hundreds of billions into creating assets that are deprecating very fast because those are commodities.”
Mensch: A single AGI system solving all problems will never exist
“There's no such thing as like one system that is going to be solving all of the problems of the world. And so at the end of the day, or you just don't believe in that context at all. It's never going to exist. I mean, there's, you have a wealth of problems, ju…”
Mensch: Open source is the only way to protect enterprise data assets
“It's also the only way in which you can create systems that are effectively using your, the folklore knowledge of your employees. That's the knowledge that you've accrued for decades. The only way in which to turn it into an asset that nobody gets access to is…”
Mensch: AI models will commoditize as knowledge diffuses across 10 global labs
“Inherently this is a technology that is going to get commoditized. The reason for that is that it's actually not hard to build. You have around 10 labs in the world. That know how to build that technology, that get access to similar data that follows the same …”
Mensch: Accelerating tech progress will create most AI value, not efficiency
“And so the acceleration of technological progress is I think where most of the value creation will be. It will take a little bit of time. And it will be less measurable less predictable than the efficiency gains that AI is going to produce. But the two things …”
Mensch: The open-to-closed AI model gap shrank to three months in 2025
“Well, if you look at the trends in 20, 24 I'd say there might have been like a six month gap. If you look at the trend in 20, 25, I think the gap is more around three months. So I guess it's up to anyone else, anyone to guess what the gap is going to be next y…”