Intelligence

“The very foundational building blocks, which I currently think are prediction, action, and goals and a combination of those three. Those are sort of the three principal components.”

“The next bottleneck of how you actually get access to that intelligence will be how you communicate with that intelligence, how you collaborate with that intelligence, and we can solve that.”

“I don't think tokens are the final unit of work or intelligence, but they are what we use today, and so it's very straightforward.”

“The constitution of intelligence itself, if you look at the, if you look at any of the leading definitions of intelligence from cognitive neurobiology, evolutionary biology, computer sciences, cybernetics, any, take any framework, take any lens that looks at i…”

“I think in the next three, four years we won't be paying for intelligence, we'll be paying for compute through our nose.”

“Yes, we have an opinion that there's going to be a premium on relationships given that intelligence is ubiquitous.”

“I think that if there was a belief that you could build a trillion dollar company just by selling intelligence from the API alone not gonna happen most likely. but what could happen is you, if you're the developer of the intelligence, you can build products w…”

“Intelligence itself, I would say yes.”

“What I don't want to see is there's only one company owns intelligence. I think that doesn't make sense to me.”

“Of all the variables that psychology measures, the two that I think are the most important are confidence and motivation, right? Confidence and motivation. People think it's intelligence, but it's actually not.”

“We're going to have to accept that intelligence isn't just biological. We can have things that are non-biological that are other beings like us, and we really don't want to share that.”

“Naval's got a great line, it's maybe, like, the ultimate Naval line, which is, the true test of intelligence is whether you get what you want out of life.”

“I don't think people have properly internalized the fact that the vast majority of intelligence comes from self training effectively.”

“We have dropped prices on the same level of intelligence year over year, sometimes by literally a factor of a hundred, right? It's like at least in order of magnitude year over year, sometimes literally a hundred.”

“I think one fallacy is thinking about intelligence as a scalar. We've consistently seen these systems have a very odd spikiness, and it's actually possible to architect a system that is world-class on some math domain, but then you could do some perturbations …”

“I do think that we will, we, I do think we should expect more speciation in the intelligences.”

“The way we see the future is you will separate memory from intelligence. So the memory will be captured by infinite layers and the intelligence will be captured by finite layers of, you know, intelligence and that small model that has those finite layers that …”

“And I think it tends to be in finance that sometimes the smartest people are the most impatient. And because they want to use their intelligence and their IQ to be like, well, how can I speed this process up and get it as fast as I can? And that's the source o…”

“The Turing test doesn't work for this consciousness question. It was designed for the intelligence question which is somewhat simpler.”

“And so the scaling laws just tell you that, like, the, you know, if you put in the ingredients to the chemical reaction, the ingredients of data and model size, that what you get out is, is intelligence. Intelligence is the product of the chemical reaction.”

“The more intelligent you are, the better you are to lying to yourself and others around you. Because you can construe almost any data into something that has, you know, a meaning that's not really there.”

“I would actually go as far as saying that intelligence is going to become a commodity.”

“There's three layers of the stack that fundamentally are going to matter. It's energy, it's compute, and it's the intelligence built on top.”

“And within this world, if you think that intelligence is going to become less distinguishable between the companies building it, And becomes a commodity probably more like oil or cloud compute than like bread at the bakery, is there's two things that matter, y…”

“You keep reducing it, commoditizing, in some sense, intelligence so that it becomes the real driver of GDP growth all around.”

“Unfortunately, it's something closer to log of intelligence equals log of compute, but we may figure out better scaling laws, and we may figure out how to beat this.”

“I think there's a natural logarithmic function associated with the amount of compute. So then, like, say for argument's sake, like, hen x more compute will double the intelligence. Maybe that's, that might be a rough rule of thumb.”

“There is a, there's only a moderate correlate. There's like a .65 correlation between frequently smart and output.”

“Once you realize that, your life will totally change because intelligence really has no correlation with how much money you can make.”

“I think it's less like the nuclear bomb where there's a self-contained technology that is so obviously relevant to specifically this like offensive capability. And you can say, well, like there's nuclear power as well, but like neither of those three, like nuc…”

“So we've seen in the industry, like a 10 X decrease in cost for a given amount of intelligence through a combination of algorithmic data and efficiency improvements.”

“And if that continues, you know, in three years, we'll have a thousand X smarter models for the same price.”

“Intelligence is a process, and skill is the output of that process. The skill itself is not intelligence, and displaying skill at any number of tasks does not show intelligence.”

“I cannot recall ever thinking until like after starting OpenAI that they were going to be so obviously related. That, you know, the, that energy would be the eventually the fundamental limiter on how much intelligence we could have.”

“I think what it kind of shows, I would say is actually, I think we're at a point now where intelligence actually isn't the bottleneck, if that makes sense. You know, I think these models are capable of solving some really, really hard problems.”

“Information knowledge, intelligence, for lack of a better word, is just going to get cheaper and cheaper, faster and faster. There's going to be, there's just intelligence is available at a price that's declining, you know, by log or log orders of magnitude ev…”

“We have kinematic frameworks for a long time. You know, we could do what humans does in terms of kinematic freedom with industrial robots. We can actually do it more precisely with higher force with industrial robots, which was what we need in manufacturing se…”

“And yeah, so I, to summarize that, you know, I see intelligence as skill acquisition efficiency. So it's not the fact that you can acquire skills, it's how efficiently You can do it. That's a measure of your intelligence.”

“There may be like natural limits to certain types of intelligence if there's not more data to iterate on.”

“We just need more software engineers who are like that forward deployed engineer to link up the intelligence and we're there.”

“For the problem that really has been my obsession for a long time is discovering the mysteries of uncovering the mysteries of intelligence. And as an engineer, I think the only way to do this is to build a machine that is intelligent, right?”

“So the combination of those three things, you know, having already a number of skills that you know, experience with solving problems and accomplishing tasks, being able to learn new tasks really quickly with a few trials and then the next step is being able t…”

“As intelligence gets cheaper and cheaper, We won't just lose all the jobs that currently require intelligence. We will just use intelligence in more and more places. I think overall, the amount of, like, tasks that, you know, we believe require some decent amo…”

“Yeah, I mean, I think it certainly requires exponential input. You know, you need to continuously be doubling your compute in order to sustain linear gains in, in intelligence. But I think that probably goes on for a very, very, very long time.”

“At the frontier of science, we do already have associations with genetics and intelligence, and we really believe in giving these insights to customers.”

“You build robotic process automation with intelligence. Those solutions are the most scalable because if you just have one piece it won't scale because if we just build intelligence, it's a, Recommendative engine, so people don't see an uplift or a value right…”

“I'm happy to be lazy in any context that I possibly can be. I think that's one of the origins of intelligence, frankly”

“I think we can drive the cost of a very high quality of intelligence to very near zero, and that will just be phenomenal for most things in the world. Not everything, there will be some negatives, but I think the cost of intelligence is about to get really, re…”

“Software development in our opinion, being a pretty good proxy task. For a big part of the spectrum of intelligence. You need an understanding, a model of the world, because we built software for the world. You need to be particularly strong at reasoning and y…”

“And when you put it as a variable and psychological model, it tends to wash out you know, things like, you know, ability or intelligence. Like it's more important in the course of the life cycle. Right up there with delayed gratification, which is another very…”

“The more accurately an LLM predicts that next word, i.e. The name of the criminal. Ipso facto, the greater its understanding, not only of the novel, but of all general human-level knowledge and intelligence, because you need all of your experience in the world…”

“There is this idea, somehow, the desire to, and the ability to dominate, is linked with intelligence. A statement that a lot of people are making, including Jeff Hinton recently, That somehow, as soon as a machine becomes intelligent, it becomes uncontrollable…”

“What characterizes intelligence is the ability to predict, first of all, and then the ability to use those prediction Those predictions as a tool to plan by predicting the consequences of actions you might take. Prediction is the essence of intelligence.”

“A sign of intelligence decades ago would be the ability to be able to easily retain information. So the ability to read something and retain it the quick recall of that information, that was a sign of intelligence. Now a sign of intelligence would be the abili…”

“And think that as systems increase in their level of intelligence at some point, usually the point at which we begin to approximate human level intelligence, the lights come on for that system and suddenly it is not only intelligent, it's also aware, but this …”

“Drive's the one that's most linearly correlated with results. Intelligence is more of a threshold value. If they're smart enough. And sure, more is better, but really it's Drive that, that, that scales.”

“These can include beliefs about whether a person like me can belong in this environment, beliefs about whether intelligence is something that's fixed or something that can grow, and those beliefs can be shifted, and they can affect how well people perform and …”

“What's gone external now is not information, what's gone external is intelligence.”

“There's a difference between consciousness and intelligence. And just because something is intelligent doesn't necessarily mean that it's conscious in the sense of capable of suffering. And just because something is capable of suffering and conscious doesn't n…”

“Intelligence is the ability to model the world and to act purposefully on it.”