Autoregressive LLMs
topic on 1 show · 2 statements across 1 episodes
2 statements about Autoregressive LLMs, every show
LeCun: Autoregressive Large Language Models Do Not Perform Real Planning
“Autoregressive LLMs basically don't do planning, or a very simple form of it.”
LeCun: Autoregressive LLMs will be obsolete within a few years
“So my prediction is that within a few years, nobody in their right mind would use auto-reversive LLMs. They'll go away in favor of something more sophisticated and controllable. They can plan its answer as opposed to just produce one word after the other react…”