StarZero All shows Try the podcast clipper →

Nov 9, 2022 · 31m · big-technology

Fantasy and Fact: AI, Sentience and The Dangers Of Hype, from World Summit AI

Professor Anil Seth · 6m spoken Alex Kantrowitz · 6m spoken Blaise Aguera y Arcas · 5m spoken Joelle Pineau · 4m spoken Francesca Rossi · 3m spoken Professor Avinash · 1m spoken Event MC · 6s spoken
0:00 / 0:00
▶ Watch on YouTube →

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

Recorded live at World Summit AI, this panel hosted by Alex Kantrowitz brings together leading AI researchers and a cognitive neuroscientist to demystify artificial intelligence, separate functional capabilities from biological consciousness, and advocate for ethical, open-source technological progress.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Alex holds 23.1% of the talking time here. How this is scored →

Alex as informed peer 4.2 Guest teaching 5.2 Guest disagreement 3.4 Alex pushing back 4.2
05100:0010:0020:0030:001:40–7:05 · Alex as informed peer 4/10 Debating AI Hype and the Generative Shift Blaise immediately rejects the host's title and binary framing of 'fact vs fantasy', calling the extreme polarities gaslighting. Joelle steps in to systematically explain how the transition from supervised to generative models transformed public and scientific debate.7:06–12:37 · Alex as informed peer 5/10 Differentiating Machine Intelligence from Biological Consciousness Anil Seth educates the audience on why intelligence and consciousness are distinct, using analogies of digestion and weather simulations to argue for biological substrate dependence. Kantrowitz pushes back with an analogy about reductive views on love.12:38–21:42 · Alex as informed peer 6/10 Defining Consciousness and Mutual Modeling in Language Models Kantrowitz brings up specific technical testing examples from Blake Lemoine regarding LaMDA breaking ethical rules under pressure. The guests clarify philosophical criteria for consciousness and distinguish anthropomorphism from mutual modeling.21:44–26:53 · Alex as informed peer 4/10 Pursuing General AI and Collective Human Intelligence Kantrowitz asks whether building AGI amounts to 'playing God' and questions spiritual dimensions. Blaise and Anil reframe the issue around collective human tool-making and human self-understanding rather than isolated individual entities.26:53–30:46 · Alex as informed peer 2/10 Audience Q&A on Ethics and Open Science During audience Q&A, Kantrowitz exerts moderation authority by making an executive decision to skip an off-topic legal liability question. Joelle briefly explains Meta's strategy around open science and code release.1:40–7:05 · Guest teaching 5/10 Debating AI Hype and the Generative Shift Blaise immediately rejects the host's title and binary framing of 'fact vs fantasy', calling the extreme polarities gaslighting. Joelle steps in to systematically explain how the transition from supervised to generative models transformed public and scientific debate.7:06–12:37 · Guest teaching 7/10 Differentiating Machine Intelligence from Biological Consciousness Anil Seth educates the audience on why intelligence and consciousness are distinct, using analogies of digestion and weather simulations to argue for biological substrate dependence. Kantrowitz pushes back with an analogy about reductive views on love.12:38–21:42 · Guest teaching 6/10 Defining Consciousness and Mutual Modeling in Language Models Kantrowitz brings up specific technical testing examples from Blake Lemoine regarding LaMDA breaking ethical rules under pressure. The guests clarify philosophical criteria for consciousness and distinguish anthropomorphism from mutual modeling.21:44–26:53 · Guest teaching 6/10 Pursuing General AI and Collective Human Intelligence Kantrowitz asks whether building AGI amounts to 'playing God' and questions spiritual dimensions. Blaise and Anil reframe the issue around collective human tool-making and human self-understanding rather than isolated individual entities.26:53–30:46 · Guest teaching 2/10 Audience Q&A on Ethics and Open Science During audience Q&A, Kantrowitz exerts moderation authority by making an executive decision to skip an off-topic legal liability question. Joelle briefly explains Meta's strategy around open science and code release.1:40–7:05 · Guest disagreement 5/10 Debating AI Hype and the Generative Shift Blaise immediately rejects the host's title and binary framing of 'fact vs fantasy', calling the extreme polarities gaslighting. Joelle steps in to systematically explain how the transition from supervised to generative models transformed public and scientific debate.7:06–12:37 · Guest disagreement 4/10 Differentiating Machine Intelligence from Biological Consciousness Anil Seth educates the audience on why intelligence and consciousness are distinct, using analogies of digestion and weather simulations to argue for biological substrate dependence. Kantrowitz pushes back with an analogy about reductive views on love.12:38–21:42 · Guest disagreement 3/10 Defining Consciousness and Mutual Modeling in Language Models Kantrowitz brings up specific technical testing examples from Blake Lemoine regarding LaMDA breaking ethical rules under pressure. The guests clarify philosophical criteria for consciousness and distinguish anthropomorphism from mutual modeling.21:44–26:53 · Guest disagreement 4/10 Pursuing General AI and Collective Human Intelligence Kantrowitz asks whether building AGI amounts to 'playing God' and questions spiritual dimensions. Blaise and Anil reframe the issue around collective human tool-making and human self-understanding rather than isolated individual entities.26:53–30:46 · Guest disagreement 1/10 Audience Q&A on Ethics and Open Science During audience Q&A, Kantrowitz exerts moderation authority by making an executive decision to skip an off-topic legal liability question. Joelle briefly explains Meta's strategy around open science and code release.1:40–7:05 · Alex pushing back 3/10 Debating AI Hype and the Generative Shift Blaise immediately rejects the host's title and binary framing of 'fact vs fantasy', calling the extreme polarities gaslighting. Joelle steps in to systematically explain how the transition from supervised to generative models transformed public and scientific debate.7:06–12:37 · Alex pushing back 5/10 Differentiating Machine Intelligence from Biological Consciousness Anil Seth educates the audience on why intelligence and consciousness are distinct, using analogies of digestion and weather simulations to argue for biological substrate dependence. Kantrowitz pushes back with an analogy about reductive views on love.12:38–21:42 · Alex pushing back 5/10 Defining Consciousness and Mutual Modeling in Language Models Kantrowitz brings up specific technical testing examples from Blake Lemoine regarding LaMDA breaking ethical rules under pressure. The guests clarify philosophical criteria for consciousness and distinguish anthropomorphism from mutual modeling.21:44–26:53 · Alex pushing back 4/10 Pursuing General AI and Collective Human Intelligence Kantrowitz asks whether building AGI amounts to 'playing God' and questions spiritual dimensions. Blaise and Anil reframe the issue around collective human tool-making and human self-understanding rather than isolated individual entities.26:53–30:46 · Alex pushing back 4/10 Audience Q&A on Ethics and Open Science During audience Q&A, Kantrowitz exerts moderation authority by making an executive decision to skip an off-topic legal liability question. Joelle briefly explains Meta's strategy around open science and code release.

speaking balance: gold is Alex, purple is the guest (3 minute bins)

0:00 · Alex 61.2% · guest 38.8%0:00 · Alex 61.2% · guest 38.8%3:00 · Alex 15.7% · guest 84.3%3:00 · Alex 15.7% · guest 84.3%6:00 · Alex 35.6% · guest 64.4%6:00 · Alex 35.6% · guest 64.4%9:00 · Alex 18.7% · guest 81.3%9:00 · Alex 18.7% · guest 81.3%12:00 · Alex 9.6% · guest 90.4%12:00 · Alex 9.6% · guest 90.4%15:00 · Alex 23.5% · guest 76.5%15:00 · Alex 23.5% · guest 76.5%18:00 · Alex 16.2% · guest 83.8%18:00 · Alex 16.2% · guest 83.8%21:00 · Alex 29.2% · guest 70.8%21:00 · Alex 29.2% · guest 70.8%24:00 · Alex 10.9% · guest 89.1%24:00 · Alex 10.9% · guest 89.1%27:00 · Alex 17.3% · guest 82.7%27:00 · Alex 17.3% · guest 82.7%30:00 · Alex 18.6% · guest 81.4%30:00 · Alex 18.6% · guest 81.4%
Sharpest disagreement ▶ 2:05 Blaise rejects the panel's binary premise

Blaise directly challenges the premise of the entire panel title, calling extreme claims on both sides gaslighting and insisting on a middle ground.

 Hardest push from Alex ▶ 10:44 Kantrowitz challenges biological reductionism

Kantrowitz refuses to accept that consciousness must be strictly biological, using the reductionist argument of love as mere chemicals to question scientific gatekeeping.

 Biggest teaching moment ▶ 9:20 Anil Seth separates functional simulation from conscious reality

Seth demonstrates why computer simulations do not create consciousness by pointing out that a weather simulation does not get wet and a robot does not digest.

 Alex holds their own ▶ 17:20 Kantrowitz introduces the LaMDA religious rule-breaking test

Kantrowitz demonstrates research expertise by presenting the exact stress-testing methodology Blake Lemoine used to argue LaMDA experienced emotional distress.
the scores for every segment, with the reasoning behind each
ChapterTopicAlex as informed peerGuest teachingGuest disagreementAlex pushing backWhy
Debating AI Hype and the Generative Shift 4553 Blaise immediately rejects the host's title and binary framing of 'fact vs fantasy', calling the extreme polarities gaslighting. Joelle steps in to systematically explain how the transition from supervised to generative models transformed public and scientific debate.
Differentiating Machine Intelligence from Biological Consciousness 5745 Anil Seth educates the audience on why intelligence and consciousness are distinct, using analogies of digestion and weather simulations to argue for biological substrate dependence. Kantrowitz pushes back with an analogy about reductive views on love.
Defining Consciousness and Mutual Modeling in Language Models 6635 Kantrowitz brings up specific technical testing examples from Blake Lemoine regarding LaMDA breaking ethical rules under pressure. The guests clarify philosophical criteria for consciousness and distinguish anthropomorphism from mutual modeling.
Pursuing General AI and Collective Human Intelligence 4644 Kantrowitz asks whether building AGI amounts to 'playing God' and questions spiritual dimensions. Blaise and Anil reframe the issue around collective human tool-making and human self-understanding rather than isolated individual entities.
Audience Q&A on Ethics and Open Science 2214 During audience Q&A, Kantrowitz exerts moderation authority by making an executive decision to skip an off-topic legal liability question. Joelle briefly explains Meta's strategy around open science and code release.

Statements from this episode (9)

Opinion
Aguera y Arcas: LLMs legitimately understand concepts without having personhood
“They can understand concepts but you know, this is not, it's not personhood.”
Blaise Aguera y Arcas Nov 9, 2022 ▶ 3:11
Insight
Pineau: The shift of compute to generative AI transformed AI debates
“That pivot towards so much energy, literally people energy, as well as computation energy, and progress being devoted to generative model is what's completely changing conversations on this.”
Joelle Pineau Nov 9, 2022 ▶ 6:50
Insight
Seth: Assuming human-level AI intelligence implies consciousness is unfounded
“And think that as systems increase in their level of intelligence at some point, usually the point at which we begin to approximate human level intelligence, the lights come on for that system and suddenly it is not only intelligent, it's also aware, but this …”
Professor Anil Seth Nov 9, 2022 ▶ 9:18
Prediction Not checkable as stated
Seth: AI will create illusion of consciousness without verifiable subjective experience
“My suspicion is that the materiality of life really matters for consciousness, and what we're likely to come up with are machines that give us the strong impression of being conscious. But for which we will just not know whether there's anything it is like to …”
Professor Anil Seth Nov 9, 2022 ▶ 10:21
Opinion
Rossi: Debating AI consciousness is not worth significant research time
“I don't think that that's a question that is, deserves a lot of a lot of time, because it's more about what this technology can do for us, and whether it has a positive impact in our life, or in the progress of humanity, or not.”
Francesca Rossi Nov 9, 2022 ▶ 15:09
Insight
Aguera y Arcas: LaMDA models users rather than just receiving human projection
“A chatbot like Lambda is generating a model of the interlocutor. That's part of what it has learned how to do in that unsupervised learning process. And so from that perspective, there's a little more going on than just anthropomorphic projection. There is tha…”
Blaise Aguera y Arcas Nov 9, 2022 ▶ 21:03
Insight
Pineau: Frontier problems for narrow and general AI are fundamentally similar
“Whether you pick this path of building AI technology to solve these shorter term problems, or you take an approach that, that is more geared towards general AI. Right now, where we stand, the types of problems that we have to solve are very similar. This notio…”
Joelle Pineau Nov 9, 2022 ▶ 22:43
Insight
Seth: The true scientific value of AGI is understanding human nature
“That for me is the sort of scientific Value of general AI. It's shedding light on what it means to be human.”
Professor Anil Seth Nov 9, 2022 ▶ 24:59
Insight
Aguera y Arcas: Foundation models reflect collective human intelligence
“Locating the spiritual element, or the, or intelligence, or any of these kind of things in the individual alone, and not thinking about that as a broader collective thing, I think is the root of a lot of cognitive dissonance. And from that perspective, you kno…”
Blaise Aguera y Arcas Nov 9, 2022 ▶ 26:12
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more