AI systems

“And I think it's going to make even more progress because if we go towards the design of AI systems, perhaps along the lines of what I described with objectives and planning, I think those systems could actually be even smaller.”

“Well, so first of all, there is no question that eventually AI systems will understand the world in similar ways that, that humans do perhaps better ways but there will not be autoregressive large language models as a type that we're now talking about.”

“If you look at how OpenAI and Anthropic and these places define AGI, it's as systems achieving capabilities that allow them to effectively do the work of humans for the majority of economically valuable human tasks. Then we're not that far away from it. And so…”

“Could one have analog computing, and we are working on that dramatically change that equation by a hundred X, both cost and power. And I think that's entirely not only possible, but likely.”

“And notice that a lot of the successful AI systems so far have been in the realm of being suggestive rather than authoritative.”

“No AI system today would be able to do that level of sort of, ah, you know, drag and drop in one situation to another situation and figure out what's going on.”

“Maybe if I had to describe it, we will shift from talking about models to talking about systems, but that'll take a while.”

“I don't think it's a phase in the sense that I do think this partnership, we'll call it, between humans and machines, where humans provide guidance to machine, like, we are in this for a long time. What will change is the nature of the information that the AI …”

“And it's not ideal, but I think we're gonna have to try and do the best we can to at least come up with a sort of set of minimum, maybe minimum standards, some benchmarks that test for undesirable properties, for example, deception. You don't, you know, nobody…”

“It wouldn't be desirable to have AI systems output tokens that are not human readable. So, you know, in some kind of machine language that We couldn't understand. I think that would, you know introduce a new vulnerability.”

“These systems are not very good at planning at long time horizons, you know, many years into the future which we is, you know, with our minds we can do.”

“Verifiability is ultimately the single most important property of success with current AI systems.”