Human Brain

“To approximate our brains, you need to have a data center that consumes the power of a million American homes running For probably six to nine months, and then you get our brains, and then every time you want to answer a question, you need the power of like a …”

“Whereas these things are exchanging information at like a trillion bits. So they're kind of billions of times better than us at sharing information. Now that's scary. It means you could have a whole swarm of these things with identical weights running on diffe…”

“Our brain actually only allows us to dream up and imagine things that are congruent with our current identity, and so we tell people, dream big, you know, be delusional, but if their identity does not align with that, their brains won't even allow them to come…”

“It's an implementation of fundamental principles, the fundamental principles of intelligence, which, you know, I think we can identify these principles and re-implement intelligence from scratch, from first principles, in a way it will be much more efficient t…”

“The average human, they speak about a 125 words per minute, but the human brain processes language at roughly 400 words per minute.”

“The human brain actually doesn't care about abstractions. It doesn't store them. In fact, the human brain stores images, stories, specific moments.”

“Anytime a brain encounters novelty, it diverts a lot of processing power to it. And so your brain is actually wired to prioritize surprise, curiosity, pattern breaks over logical information.”

“Human brains run on 20 watts of energy. That's, that is true. But if you look at mammalian brains generally, actually extremely efficient, like a squirrel or a cat, it's like a 10th of a watt.”

“This could have been sexual selection, not natural selection. Because what do we use our big brains for? We use it to write poetry, and do art, and be funny, and all these kind of things. So we use it for seduction. So there's an argument that this thing is, a…”

“Our brains use about 20 watts of power, but, and of that, only about 10 watts is higher brain function.”

“A lot of people don't realize your brain is only really able to focus for two or three hours a day.”

“Personally, I don't want to meddle with, you know, human human brain if, you know, just to improve and augment our capability.”

“H 100 has the same amount of flops as a human brain.”

“What I would call AGI, is really a more theoretical construct, which is what is the human brain as an architecture able to do, right? And that's, the human brain's an important reference point because it's the only evidence we have maybe in the universe that g…”

“Language is not actually how our brain thinks. It's just a representation for which it to, you know, reason over.”

“The human brain is probably some sort of Turing machine. At least that's what I believe.”

“I think transformers are actually better than the human brain in a bunch of ways. I think they're actually a lot more efficient system. And the reason they don't work as good as the human brain is mostly data issue, roughly speaking, is the first order approxi…”

“We have two very strong inbuilt default modes in the human brain, one of which is habit. Do what I've done before. And the other one is social copying. Do what everybody else seems to be doing. And they make extraordinarily good sense in evolutionary terms bec…”

“Fundamentally, it's a bunch of parameters, right? So it's much more interpretable than a human brain or something.”

“So if you look at energy consumption, physical space, speed of signal transmission, and the frequency on the signal, you're looking at six to seven orders of magnitude in every direction, just with present day technology.”

“We have proof points of, you know, a sort of a 20 watt organ that you know, sits between our ears that, that is artificial general intelligence that is many, many, many orders of magnitude more efficient than the Digital artificial neural networks that we're b…”

“I'm very bullish on human augmentation in the very long term, but it's one that I don't see intuitively. I think looking at our brains, even just physically, they seem to be very focused, and this is not surprising, on our IO. And why would there somewhere in …”

“But I think that's because we confuse fine tuning and pre-training. Pre-training is all of evolution. And then basically you arrive at this thing that It's maybe doing something that's completely, in a certain sense, a completely irrelevant task at first, but …”

“The brain, like we don't replace our brain. If we do some math and then we ask like, you know, a sentiment question and then we ask a translation question, we use the same brain. So there is an existence proof for a single model. For all of NLP”

“The way I think about it is that we are still pretty far away from the level of scale that is the human brain. And so there's no reason for there to be an asymptote. I think it just keeps working.”

“There's no machinery in our brains innately to tell us the difference between a person and machine. And what happens is that in evolutionary perspective, anything that could talk was probably a person, right?”

“In fact, your perception of the world is not the world as it is. It's the world as it's going to be, because there is, you know, about a hundred millisecond delay between what you see and how your brain interprets what it is. So so in fact your brain predicts …”

“Ah, the only thing your brain does is turn muscles on and off. There's nothing else that it does.”

“Technology is for our brains, what sugar is for our gut. You know, our bodies have a natural craving for cheap calories and our brains have a natural craving for connection. And what sugar is doing to, you know, fatten us up because we weren't prepared for thi…”

“There's something about a mechanical device That produces answers that makes the human brain ascribe way more authority to it than there necessarily should be.”

“There's quite a bit of evidence that the way the brain does it, as you say, is, is to actually use the very same bits of neurological apparatus that it uses to do things for real. It's just kind of turning off the output.”

“There's no reason to believe that we are near the limits of intelligence that are allowed by the laws of physics, right? And so, eventually, sure, you know, it could be possible to produce beings that are much more intelligent than we are.”

“The way the human brain works is your best ideas come to you when you're not thinking about them. You know if you're sitting there always doing other things and chatting with people and texting them, The brain won't have the mental space to unconsciously proce…”

“I think that the only means to solve the deepest problems that humanity faces is actually to alter the human brain itself.”

“And after about three or four dimensions, your mind just kind of gives up. Your brain isn't programmed or optimized for that type of mathematical optimization, but machine learning algorithms love lots of data and are able to do this in a way that human brains…”

“Well, depending on how you calculate it, we're pretty close to human brain scale computing already in the world's fastest supercomputers. And we will get there within the next couple of years.”

“The human brain kind of on its own, unaided with Rolodexes and other stuff, on average, kind of starts, stops being effective around, you know, over a hundred relationships, and so, you know, I think that's a way of thinking about how we are maybe naturally wi…”

“And if you compute the equivalent energy required per neuron, and extrapolating that, it'll take about 50 years to get the equivalent human brain.”

“There's another metric you look at in terms of traverse edges per second. And when you look at that, and you say, well, when would it take for it to become human in terms of cost? That's in about 16 years.”

“This is what the human brain does so incredibly well, and what our technology today is currently almost entirely unable to do.”