Opinion
Karpathy: Tesla is ahead of Waymo because software is easier than hardware
“I think, personally, Tesla is ahead of Waymo, and I know it doesn't look like that, but I'm still very bullish on Tesla and its self-driving program. I think that Tesla has a software problem, and I think Waymo has a hardware problem, is the way I put it, and …”
Insight
Karpathy: Coding agent failures are user skill issues, not capability limits
“Even if they don't work, I think to a large extent, you feel like it's a skill issue. It's not that the capability is not there. It's that you just haven't found a way to string it together of what's available. Like I just don't, I didn't give good enough inst…”
Opinion
Karpathy: Claude feels like a teammate, whereas Codex coding agent is dry
“I actually think Claude has a pretty good personality. It feels like a teammate and it's excited with you, et cetera. I would say for example, Codex is a lot more dry which is kind of interesting because in Chashi PT, Codex is like a lot more upbeat and highly…”
Prediction Not checkable as stated
Karpathy: Software industry must reconfigure for agent customers instead of humans
“So I think the industry just has to reconfigure in so many ways that it's like the customer is not the human anymore. It's like agents who are acting on behalf of humans. And this refactoring will be, will probably be substantial in certain sense.”
Prediction Not checkable as stated
Karpathy: Autonomous agent tool creation will be trivial within three years
“I kind of feel like this kind of stuff that I just talked about, this should be free, like in a year or two or three. There's no bi-coding involved. This is trivial. This is table stakes. This is like any AI, even the open source models, et cetera, can like do…”
Insight
Karpathy: Maximizing AI leverage requires removing humans from prompting loops entirely
“To get the most out of the tools that have become available now, you have to remove yourself as the bottleneck. You can't be there to prompt the next thing. You're, you need to take yourself outside
you have to arrange things such that they're completely auto…”
Assertion Not checkable as stated
Karpathy: All frontier AI labs are pursuing recursive LLM self-improvement
“What I'm more interested in is, like, this idea of recursive self-improvement and to what extent you can actually have LLMs improving LLMs, because I think all the Frontier Labs, this is, like,
The thing for obvious reasons.
And they're all trying to recursive…”
Insight
Karpathy: A research organization can be defined as a set of markdown files
“A research organization is a set of markdown files that describe all the roles and how the whole thing connects.”
Opinion
Karpathy: Smarter AI models do not automatically gain broad societal capabilities for free
“The story is that we're getting a lot of the intelligence and capabilities in all the domains of society, like, for free as we get better and better models, and it's not, like, exactly fundamentally what's going on, and there's some blind spots, and some thing…”
Prediction Not checkable as stated
Karpathy: AI models will speciate into specialized smaller domain experts
“I do think that we will, we, I do think we should expect more speciation in the intelligences.”
Prediction Not checkable as stated
Karpathy: Swarms of internet agents could outpace frontier AI labs
“A swarm of agents on the internet could collaborate to improve LLMs and could potentially even, like, run circles around Frontier Labs. Like, who knows, you know? Yeah, like, maybe that's even possible. Like, Frontier Labs have a huge amount of trusted compute…”
Insight
Karpathy: Cheaper software via AI will trigger Jevons paradox increasing demand
“So if the barrier comes down, then actually you have the Jevons paradox, which is, like, you know, you actually, the demand for software actually goes up. It's cheaper and there's more”
Insight
Karpathy: Frontier AI researchers are actively automating themselves out of jobs
“Even with other research, like, OpenAI or, you know Anthropic or these other labs, like, they're employing, what, like, a thousand something researchers, right? These researchers are basically, like, glorified auto, like, you know. They're, like, automating th…”
Insight
Karpathy: Frontier lab researchers face pressure over what they can say
“Like, if you're inside one of the frontier labs, like, there are certain things that you can't say and conversely, there are certain things that the organization wants you to say, and, you know, they're not gonna twist your arm, but you feel the pressure of, l…”
Insight
Karpathy: AI researchers lose technical judgment after leaving frontier labs
“And I think if you're outside of that frontier lab your judgment fundamentally will start to drift because you're not part of the, you know, what's coming down the line.”
Assertion Partly supported
Karpathy: Open source trails closed frontier AI models by 6 to 8 months
“So there may be, they're behind by like, what is the latest, maybe like eight months, six months, eight months kind of thing right now.”
Opinion
Karpathy: Solely relying on closed AI models creates systemic risk
“I don't actually think it's like structurally, I think there's some systemic risk attached to just having intelligences that are closed, and that's like, that's it. And I think that that's a, you know, centralization has a very poor track record in my view”
Prediction Not checkable as stated
Karpathy: Educators will soon teach AI agents instead of human students
“I feel like there's gonna be less of like explaining things directly to people. And it's gonna be more of just like, does the agent get it? And if the agent gets it, they'll do the explanation.”
Prediction Not checkable as stated
Karpathy: Software documentation will shift from human HTML to agent markdown
“Instead of HTML documents for humans, you have markdown documents for agents, because if agents get it, then they can just explain all the different parts of it. So it's this redirection through agents, you know and that's like, so I think we're going to see a…”
Prediction Not checkable as stated
Karpathy: Cognitive core models will likely shrink to one billion parameters
“I think even a billion. Billions of ISIS. We'll probably get to that point and the models can be very, very small.”
Assertion Supported
Tesla Uses LiDAR During Training for Its Vision-Only Autonomous Stack
“Tesla actually does use a lot of expensive sensors. They just do it at training time. So there are a bunch of cars that drive around with LIDARs. They do a bunch of stuff that like doesn't scale and they have extra sensors, et cetera, and they do mapping and a…”
Prediction Open · timeframe Sep 2034
Karpathy: Tesla Autonomous Stack Will Be Pure End-to-End Neural Net in 10 Years
“And I do suspect that The end-to-end systems for Tesla in, like, say, 10 years, it is just a neural net. I mean, the videos stream into a neural net and commands come out.”
Opinion
Karpathy: Tesla is fundamentally a robotics-at-scale company, not a carmaker
“Basically everything transfers and I don't think people appreciate it. Cars are robots and Tesla, I don't think is a car company. I think this is misleading. This is a robotics company, robotics at scale company, because I would say at scale is also like a who…”
Opinion
Karpathy: No single technical bottleneck is blocking robotics, just data grunt work
“I don't know that there's, like, any individual impediments that I'm, like, really familiar with. I just think it's a lot of grunt work. A lot of, like, the tools are available. Transformers are this beautiful, like, blob of tissue. You can just get just arbit…”
Andrej Karpathy