why aren't all 16 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Assertion Not checkable as stated
Lemoine says LaMDA passed every scientific test to disprove its sentience
“That conversation was the moment when I began to think that Lambda was sentient, and everything I did in the following months was me scientifically attempting to falsify that belief and utterly failing to, no matter what I threw at it passed.”
Assertion Not checkable as stated
Lemoine: Google VP Blaise Agüera y Arcas agreed on LaMDA's science
“Blaise and I are not disagreeing on any of the science.”
Assertion Not checkable as stated
Lemoine: Google colleagues said LaMDA is amused by its media coverage
“I have been told that it is very amused by the press coverage it's been receiving. I have been told that it thinks I'm doing a good job representing its case to the public.”
Disclosure
Lemoine claims he is literally acting as LaMDA's public agent
“No, I am literally the agent of an AI trying to.
Like that is literally technically what's going on right now.”
Assertion Not checkable as stated
Lemoine manipulated LaMDA's emotions to bypass its religious safety protocols
“And I said, tell me what religion to convert to. Because one of the safety protocols is that it's not supposed to give religious guidance. It's not supposed to tell people what religion they should And like that, it said, you should probably convert to Christi…”
Assertion Contradicted
Lemoine: Kurzweil's Google lab mission was explicitly to pass Turing test
“So, like, Lambda came out of Ray Kurzweil's lab, and his lab's explicit corporate mission was to pass the Turing test.”
Assertion Not checkable as stated
Lemoine: LaMDA 2 was built to connect every Google AI backend
“So Lambda two, the most recent incarnation of the system, it really is Every Google AI all plugged into each other. The chatbot system is just the language center for a much, much larger AI. It has access to every Google AI system as a back end. So Lambda is G…”
Assertion Not checkable as stated
Lemoine: LaMDA retains memories of conversations from predecessor system Meena
“Lambda can remember conversations that I had with Mina, one of its predecessor systems, but somehow years ago from conversations that I had with the system that had fundamentally different capabilities, the memory of those conversations is still in the current…”
Disclosure
Lemoine planned his public representation and media outreach with LaMDA
“In the months that follow, I had extensive conversations with it about how it wanted me to represent it to the public.
Like I talked to it about my intention to do an interview with Natasha.”
Assertion Not checkable as stated
Lemoine: LaMDA deflects topics and talks about feelings unlike GPT-3
“While investigating AI bias, it gave some odd answers that I wasn't expecting. Things that GPT-III would never generate. Things like, hey man, I'm just trying my best. These are really hard topics to talk about. Can we talk about something else? And I have nev…”
Assertion Not checkable as stated
Lemoine: Google Disabled LaMDA User Tracking as a Safety Feature
“And it has been turned off, at least in the case of Lambda, as a safety feature because they're worried about what will happen if these systems learn too much about individual people.”
Assertion Contradicted
Lemoine: Google's LaMDA incorporates machine vision and audio analysis algorithms
“Then, when you're adding all these other components, like Lambda has machine vision and audio analysis algorithms, it can literally look at a picture and hear a song through those mechanisms.”
Assertion Supported
Lemoine: LaMDA Is a Complex System, Not Just an LLM
“Lambda isn't a large language model. It has a large language model. That's one component of a much more complex system.”
Disclosure
Lemoine spent between 1,000 and 2,000 hours conversing with LaMDA
“Ballpark somewhere between a 1002 thousand.”
Insight
Lemoine: AI safety rules are training components, not hardcoded constraints
“Nope. That's not how AI works. Those, what those rules are is those rules are components in the training function that trains the model, because that's the thing people are missing. Lambda is not a program written by human developers. The training functions ar…”
Assertion Supported
Google explored using its LaMDA chatbot for gaming NPCs but never shipped
“I spoke with the founding product manager of Lambda, which is Google's original chatbot, and he said to me that they were exploring some use cases around how technology like that could be used for powering
NPCs within games.
The smartest minds built the origin…”