Hotz: AI scaling laws deliver linear returns for exponential capital
George Hotz · Weekly Recap: Elon's Starship Explodes, OpenAI's Defense Contract, Nvidia's Robots, We Test Cluely · Jun 21, 2025 · at 2:03:55
George Hotz critiques current frontier model pre-training dynamics during an interview on the TBPN podcast.
0:00 / 0:05exact quote · 5.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“AI scaling laws. You can put in exponentially more money to get linear returns.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from George Hotz
Hotz: AI application wrappers like Cursor and Windsurf will fail
“And then on top you have, like, completely worthless things like cursor and windsurf you know, these character AI, all these people who think, oh, we're the app, we're gonna get the ARR. No, that worked in the web, it won't work for AI”
Hotz: Waymo robotaxis require approximately 1.2 remote human operators per car
“There's probably about, I would say there's 1.2 operators per car. But it's not, they don't have a steering wheel and pedals. It is an autonomous system that they're probably doing some higher level inputs on.”
Hotz: AI is a far better military technology than nuclear weapons
“So, like, as a military technology, nukes are not that good. AI is way better.”
Hotz: Robotaxis will be a scooter-style capital race to the bottom
“Self-driving cars look like scooters. The only thing that it's going to take to roll out big fleets of self-driving cars is capital, right? It's just strictly a capital market... So self-driving cars are going to be this awesome race to the bottom, right? It's…”
Hotz: Robotic arm hardware is good enough, robotics is strictly software
“The arms are already good enough. It's the off the shelf arms are fine. It's all software. Again, it's always all software. Autonomous vehicles are all software. Robotics is all software”
Hotz: Shift to diffusion AI models will erode centralized cloud moats
“With AI, I think there's going to be a much less of a moat. Especially when you look at the move from autoregression to diffusion. So autoregression can run in large batch sizes. When you run ChatGPT, you're running with a whole bunch of other people on that s…”