General Intelligence

“If you actually have a problem that you can specialize the model around with your reasoning traces, You can start to create this compounding advantage in your domain for your customer base, where you're able to kind of shape the intelligence to be better than …”

“So, you know, I sometimes call these systems jagged intelligences because they're really amazing at certain things when you pose the question in a certain way. But if you pose a question in a slightly different way, they can actually still fail at quite elemen…”

“General intelligence is human level. Skill acquisition efficiency on the same scope of tasks that humans could potentially learn to do.”

“The story is that we're getting a lot of the intelligence and capabilities in all the domains of society, like, for free as we get better and better models, and it's not, like, exactly fundamentally what's going on, and there's some blind spots, and some thing…”

“There's just general intelligence, it's low margin, it's, I mean, it's great, I'm, like, literally building stuff as we talk, I'm, like, into it, but I think it's a terrible business.”

“Our field became obsessed with the idea that general intelligence would spontaneously emerge by cramming more and more data into bigger and bigger models.”

“LLM still can't run a gas station, you know, just because it involves all of these things that for us with general intelligence, it's no big deal for an AI. It's gonna have, it's just, it's not there. So we're still the king of the general intelligence castle.”

“Effectively what large language models do today is they are high dimensional memorization systems, right? They are trained on lots of training data. They're able to find and generalize patterns off of the training data that they're trained on and then apply th…”

“Sort of on the world scale, like, you know, somebody else will build a model if open AI disappeared and continue towards this progress of general intelligence.”

“The thing about general intelligence is you have to solve many different problems to have, you know, the ability to claim general intelligence, and fortunately, there are a lot of use cases across Meta, across our family of products, and so that's giving us wo…”

“It gives us a path. It may not be the path, but it gives us at least a path to move towards general intelligence. And it's an exciting one. It's one that, that we're exploring. It doesn't mean that we've stopped exploring other paths towards general intelligen…”

“Often this notion of general intelligence is, is articulated in, in the context of like a single agent, a single uber intelligent agent. And I don't think that's really where we will move towards either.”

“I think the Turing test is no longer really a useful measure the way it was intended to be. Certainly Just because we have bots that can, I wouldn't say they can pass the Turing test, but I mean, like they're getting close enough that it's no longer that usefu…”

“Human intelligence is no, it's not general. It's actually very, very specific to our world. It's very biased. It's really customized to survival human in, on our planet. So the concept of general intelligence, I mean, yes, humans tend to have a more general in…”

“I think one of the big risks that we run as a machine learning community is the incredible amount of hyperbole that's going on right now, where it's like, we're gonna have general intelligence right around the corner. We're not. Ok, we really aren't.”

“He says, I think we need a reboot. I think the path that I set everybody on, and fundamentally an algorithm called backpropagation, I think that's a dead end. I think if we want general intelligence, we're going to need to invent a new technique. We're going t…”

“To my mind, DQN is in a sense, one of the very first general intelligences because it learns completely from scratch. You can throw A whole variety of problems at it, and it, you know, it doesn't always do that well, but in many cases it does pretty well.”