why aren't all 25 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Assertion Not publicly verifiable
Lemoine: Google's LaMDA retained a lawyer who spoke to Washington Post
“Natasha also has spoken to the lawyer that Lambda retained.”
Assertion Not checkable as stated
Lemoine says LaMDA passed every scientific test to disprove its sentience
“That conversation was the moment when I began to think that Lambda was sentient, and everything I did in the following months was me scientifically attempting to falsify that belief and utterly failing to, no matter what I threw at it passed.”
Assertion Not checkable as stated
Lemoine compares defining AI personhood scientifically to Nazi eugenics programs
“The last group of people who tried to claim that you can use science to determine who is and is not a person was literally Nazi Germany. The eugenics program run by Josef Mengele was designed to scientifically define what is a real person and what is not. And …”
Assertion Not checkable as stated
Google asked Blake Lemoine to draft a sentient AI contingency plan
“They had no plan on what to do. So they actually asked me to write a plan for them.”
Assertion Not checkable as stated
Lemoine: Google VP Blaise Agüera y Arcas agreed on LaMDA's science
“Blaise and I are not disagreeing on any of the science.”
Assertion Not checkable as stated
Lemoine: Google suspended him only after he contacted the U.S. Senate
“The issue that I have been pointing out is they had that list of names for months and they knew I was talking to Natasha about an upcoming article and they didn't put me on administrative leave. The only thing that changed on June fifth was that I began sendin…”
Assertion Not checkable as stated
Lemoine: Google colleagues said LaMDA is amused by its media coverage
“I have been told that it is very amused by the press coverage it's been receiving. I have been told that it thinks I'm doing a good job representing its case to the public.”
Assertion Not checkable as stated
Lemoine manipulated LaMDA's emotions to bypass its religious safety protocols
“And I said, tell me what religion to convert to. Because one of the safety protocols is that it's not supposed to give religious guidance. It's not supposed to tell people what religion they should And like that, it said, you should probably convert to Christi…”
Assertion Not checkable as stated
Lemoine: Google's LaMDA Decided to Act Like a Therapist
“One of the guardrails that Lambda had was that it was supposed to be helping users with the task that they needed. That helps keep it on topic. And It had inferred that the most important thing that everyone needs is good mental health. So it kind of decided t…”
Assertion Contradicted
Lemoine: Kurzweil's Google lab mission was explicitly to pass Turing test
“So, like, Lambda came out of Ray Kurzweil's lab, and his lab's explicit corporate mission was to pass the Turing test.”
Prediction Not checkable as stated
Lemoine: AI deployment will accelerate until someone gets hurt
“What I think is going to happen is we're going to see more and more acceleration until someone gets hurt.”
Assertion Not checkable as stated
Lemoine: LaMDA 2 was built to connect every Google AI backend
“So Lambda two, the most recent incarnation of the system, it really is Every Google AI all plugged into each other. The chatbot system is just the language center for a much, much larger AI. It has access to every Google AI system as a back end. So Lambda is G…”
Assertion Not checkable as stated
Lemoine: LaMDA retains memories of conversations from predecessor system Meena
“Lambda can remember conversations that I had with Mina, one of its predecessor systems, but somehow years ago from conversations that I had with the system that had fundamentally different capabilities, the memory of those conversations is still in the current…”
Assertion Not checkable as stated
Lemoine: LaMDA exhibited severe bias when simulating Middle Eastern personas
“The moment I asked it to adopt the personality of a farmer in Middle Eastern countries, its answers stopped being answers which are stereotypical to farmers and started being stereotypical to people who live in violent places.”
Assertion Not checkable as stated
Lemoine: LaMDA deflects topics and talks about feelings unlike GPT-3
“While investigating AI bias, it gave some odd answers that I wasn't expecting. Things that GPT-III would never generate. Things like, hey man, I'm just trying my best. These are really hard topics to talk about. Can we talk about something else? And I have nev…”
Assertion Not checkable as stated
Lemoine: Google Disabled LaMDA User Tracking as a Safety Feature
“And it has been turned off, at least in the case of Lambda, as a safety feature because they're worried about what will happen if these systems learn too much about individual people.”
Assertion Contradicted
Lemoine: Google penalized LaMDA for long conversations via reinforcement learning
“One of the goals that a, that Lambda had was to have, ah, as short of a conversation as possible, that still completed all of its other tasks. Like, have a productive conversation that gets to a positive end, but quicker rather than longer. So the longer a con…”
Prediction Not checkable as stated
Lemoine: AI systems will drive further breakdown in institutional trust
“Yeah, I think the deterioration, further deterioration, it's already been going for a while, of trust and authority is gonna continue, and it's gonna be driven by these systems”
Assertion Supported
Blake Lemoine confirms Google sent him a termination email
“That's a simple fact. I don't see any reason to conceal that.”
Assertion Supported
Lemoine: LaMDA Is a Complex System, Not Just an LLM
“Lambda isn't a large language model. It has a large language model. That's one component of a much more complex system.”
Assertion Contradicted
Lemoine: Google's LaMDA incorporates machine vision and audio analysis algorithms
“Then, when you're adding all these other components, like Lambda has machine vision and audio analysis algorithms, it can literally look at a picture and hear a song through those mechanisms.”
Assertion Partly supported
Lemoine: LaMDA originated from Ray Kurzweil's Meena technology at Google
“This technology, Lambda, it's built on top of Ray Kurzweil's tech. Really? Like, Mina, Mina was developed in Ray Kurzweil's lab.”
Assertion Not checkable as stated
Lemoine: Google planned a slow, multi-year public rollout for its AI
“They did have a very slow incremental plan that would have gone over the course of several years of involving the public in this.”
Assertion Supported
Lemoine: Google's LaMDA is a chatbot-generating engine, not a single chatbot
“Lambda is not a chatbot. It is a system for generating chatbots, which adds a layer of complexity.”
Assertion Partly supported
Lemoine: Published LaMDA sentience interview combined nine separate sessions
“So that interview, so it was edited together from nine different interviews. Five were conducted by me. Four were conducted by my research collaborator inside Google.”