Turing Test

“However, it just means that the Turing test is a bad way of measuring intelligence, because there is no AI in the physical world, outside of the screen, that can do all the things that a little boy can do, that can do the things that a plumber can do.”

“I mean, if you think about, oh, there was a Turing test, blew it away. I mean, you think about that, that any period of time, sort of 1015, 20, 3040, 50 years ago, we, any definition we would have previously put forward. We've blown past it.”

“We have our own behavior Turing test. It's sort of slightly different from existing Turing tests because Turing tests as our design are pretty binary. They're either human or not, but you know, the reality is that these things exist on a spectrum of humanness,…”

“That's the simpler way of saying what I'm saying is that we have passed the Turing test with text LLMs a long time ago, and we're actually nowhere near that on voice LLMs.”

“The bots can pass the Turing test. And if the bots can pass the Turing test, then you can't screen for bot. You can't have proof of not a bot, but what you can have is you can have proof of human.”

“The Turing test doesn't work for this consciousness question. It was designed for the intelligence question which is somewhat simpler.”

“We will see in 12 to 18 months voice models approaching human Turing tests, and that's not just from an IQ perspective and information retrieval, it's EQ as well, as we just talked about in naturalness.”

“For 80 years, the Turing test, I mean, they made a movie about it, like the whole thing. That was the thing. And like, we blew right through it and nobody even registered it. Nobody cares. It gets no credit for it.”

“That is how I interpret it, and the Turing test has passed. It's, what's crazy to me is, like, we just passed it, and no one seemed to care.”

“And now obviously AI has blown past the Turing test.”

“Twenty-twenty-two November, ChadGBT blasted open the door of truly working generation models that can basically pass the Turing test and all that.”

“So at this point, like, you know, the truth is, you know, GPT-IV-O and like O-III, these models are like passing the Turing test.”

“I think in a lot of domains, and this is sort of the year where, like, Maybe there's, like, five or 10% of things that, like, it's, you know, sort of hitting the Turing test and, you know, really satisfying that, but, you know, I think maybe this is a year whe…”

“One of my biggest anxieties is that, like, generally, to your point, CAPTCHAs are broken, right? Which, like, hey, we passed the Turing test a while ago. For some reason, we just blew past that and don't talk about it enough. We all are blowing past what effec…”

“At this point, AI has passed Turing tests and is solving all of these very menial problems over the phone.”

“There was the Turing test of, you know, which got passed some months or years back without even being noticed. Because you can't tell the difference now in having a chat with a lot of the chat bots, whether they're human or not.”

“At some point in the last few years, we casually skipped the Turing test, right? We broke through it.”

“The trick is, if the output is the same as a human, then I'm happy, basically. I don't really care about what's going on inside. And so it feels like caring about the inside is like a pretty high bar. Like, why do you care? It's kind of like the plane thing, l…”

“I think the Turing test is no longer really a useful measure the way it was intended to be. Certainly Just because we have bots that can, I wouldn't say they can pass the Turing test, but I mean, like they're getting close enough that it's no longer that usefu…”

“I think that the Turing test was an error in, in AI history. I mean, Turing's obviously a brilliant man, and he, you know, made enormous contributions to computer science, but I think that the Turing test has been an exercise in fooling people. We've now solve…”

“So, like, Lambda came out of Ray Kurzweil's lab, and his lab's explicit corporate mission was to pass the Turing test.”

“ChatGPT can pass the Turing test. I mean, you may not think it's a very bright person. I mean, this is the thing. I was plugging in my questions. I remember from when I was at history undergraduate, like, yeah, these are all C grade D grade answers. They are a…”

“ChatGPT is, you know, it is better, it is in, on some axes, it is cleverer than dumb people. And so that, that kind of means the Turing test doesn't work anymore.”

“The Turing test, as you say, is like a flawed metric, and the reason for this is in part because It is too low of a bar. It is a binary bar, so it's either intelligent or not intelligent, and it tests for deception, not real understanding.”

“The Turing, you know, Alan Turing was a genius, but the Turing test is malformed. Humans are too easy to trick. But that's too low of a bar, because tricking a person is not that hard, and does not prove anything other than that you've tricked the person.”