Everything Gary Marcus said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Marcus: A death will be tied to an LLM within a year
“The prediction that I made Is basically that there will be a death tied to a large language model in the next year.”
Marcus: OpenAI's Project Orion failed and became GPT-4.5
“So OpenAI tried to build GPT-V and they had a thing called Project Orion and it actually failed. And eventually got released as GPT four and a half. So what they thought was going to be GPT five just didn't meet expectations.”
Marcus: Models like o1 are not systematically better than GPT-4
“Models like O-I are not systematically better than GPT-IV. There's, they're better in certain use cases. Especially ones where you can create data in advance.”
Marcus: 'Reasoning' AI models only mimic patterns without genuine abstractions
“Now, the reason I wouldn't call them reasoning models, though you're right that many people do, is what I think they're doing is basically copying patterns of human reasoning. They're getting data about how humans reason certain things, but the depth of reason…”
Marcus: AI scaling laws are no longer true
“So the scaling quote laws were empirical guesses about how these models work and they were true for a little while, which was amazing. And they're not true anymore, which is also amazing in a way.”
Marcus: OpenAI is not worth $300B and won't IPO at $3T
“I don't think LLMs will disappear. I think they're useful, but this, yeah, the valuations don't make sense. I mean, I don't see open AI being worth three hundred billion dollars. And you have to remember that venture capitalists have to like 10 X to be happy o…”
Marcus: No AI lab has a technical moat; OpenAI has users
“Nobody has a technical mode. OpenAI has a user mode.”
Marcus: Gen AI's core business model will be surveillance and ads
“The business model of gen AI will be surveillance and hyper-targeted ads, just like it has been for social media.”
Marcus: Microsoft launched Bing Chat despite negative India test feedback
“And then the other really disturbing thing is that apparently they tested in India and got, you know, customer service requests saying it's not ready for prime time. And it was, you know, still put out.”
Marcus: The Turing test was an error in AI history
“I think that the Turing test was an error in, in AI history. I mean, Turing's obviously a brilliant man, and he, you know, made enormous contributions to computer science, but I think that the Turing test has been an exercise in fooling people. We've now solve…”
Marcus: LaMDA Possesses No Internal Model of the World
“When I'm going through this in some depth, because when we get to Lambda, Lambda doesn't have a model of the world.”
Marcus: LaMDA Is Merely Autocomplete on Steroids, Not Sentient
“My turn-by-turn system has more elements of what I would actually ascribe sentience than Lambda, which is really just autocomplete on steroids. That's all it is, right? You type in your phone, I will meet you at, and it guesses that, you know, you might say th…”
Marcus: Nobody knows how to prevent chatbots from being toxic or misleading
“Nobody knows, you know, how to make their chatbots constrained and not toxic and not spew misinformation.”
Marcus: The AI field is facing the same unsolved problems as 2015
“Despite all the hype about, you know, we're so close to solving AI or whatever. We're not, we're facing the same problems.”
Marcus challenges Andrew Ng: AI cannot automate every one-second mental task
“I don't think it's true at all, so there are some things that people can do in a second that AI can automate, and there are other things that it can't”
Marcus: Drivers should not trust Tesla Autopilot because AI remains unready
“So you should not be trusting a Tesla. Elon might get on 60 minutes and take his hands off the wheel, but you should not be doing the same because the technology is not really there yet.”
Marcus: Current AI techniques are too brittle to earn public trust
“Most of why I don't think we should trust AI right now is that the current techniques that people are using are simply too brittle to earn the trust that we're giving them.”
Marcus: Deep learning models are giant correlation machines without causal understanding
“These systems are just giant correlation machines. They have no understanding of causation.”
Marcus: Deep learning cannot perform common sense, planning, analogy, or reasoning
“Perception is what deep learning does, and actually it only does a small part of perception. There's lots of parts of perception where we use our knowledge about the world that it doesn't capture. And then there are all these other things like common sense and…”
Marcus: Deep learning is a better ladder but cannot reach the moon
“Deep learning is a better ladder for sure, but a better ladder doesn't necessarily get you to the moon.”
Marcus: Siri's technology is not fundamentally different from ELIZA
“But the technology for Siri is not really that different from the technology for ELISA, and Siri is still very far from artificial general intelligence.”
Marcus: Deep learning alone won't solve common-sense AI without symbolic systems
“Deep learning doesn't seem to be getting us there. The old systems, in some ways, we're better at that. We do need a marriage between the two.”
Marcus: Grok 3 delivers minimal gains despite 10x compute
“So he built Grok three and by his own testimony, it was 10 times the size of Grok two. It's a little better, but it's not night and day, right? Grok two was night and day better than the original Grok. GPT four was night and day better than GPT three. GPT thre…”
Marcus: AI coding assistants regurgitate public code but cannot debug software
“That's their sweet spot is regurgitation. And so Yeah, they can build the stuff that's out there, but if you want to code things in the real world, you usually want to code something that's new, and these systems have a lot of problems with that. And another r…”