Marcus: Deep learning models are giant correlation machines without causal understanding
Gary Marcus · Rebooting AI // Gary Marcus, Robust AI (FirstMark's Data Driven NYC) · Sep 17, 2019 · at 12:56
Gary Marcus, cognitive scientist and founder of Robust AI, argues that AI language models like GPT-2 operate purely through word correlation without comprehending causal relationships.
0:00 / 0:04exact quote · 4.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“These systems are just giant correlation machines. They have no understanding of causation.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Gary Marcus
Marcus challenges Andrew Ng: AI cannot automate every one-second mental task
“I don't think it's true at all, so there are some things that people can do in a second that AI can automate, and there are other things that it can't”
Marcus: Drivers should not trust Tesla Autopilot because AI remains unready
“So you should not be trusting a Tesla. Elon might get on 60 minutes and take his hands off the wheel, but you should not be doing the same because the technology is not really there yet.”
Marcus: Current AI techniques are too brittle to earn public trust
“Most of why I don't think we should trust AI right now is that the current techniques that people are using are simply too brittle to earn the trust that we're giving them.”
Marcus: Deep learning cannot perform common sense, planning, analogy, or reasoning
“Perception is what deep learning does, and actually it only does a small part of perception. There's lots of parts of perception where we use our knowledge about the world that it doesn't capture. And then there are all these other things like common sense and…”