LLMs

“Chatbots are or LLMs, large language models, are a special case of that, where you train a system to predict a word, But you only allow it to look at the words that precede it, you know, that are to the left of it.”

“The smartest LLMs are not as smart as your house cat. And it's really true.”

“LLMs are system one. The architecture I'm describing, which I call objective driven AI, is system two.”

“LLMs are not the path to human level intelligence. LLMs work for discrete worlds. They don't work for continuous, high dimensional worlds, which is the case for video. And this is why LLMs do not understand the physical world and cannot be used in their curren…”