transformer architecture
also referred to as: transformer architectures
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Nov 27, 2024 by Yann LeCun · across every show →
Everything said about transformer architecture, oldest first
Nov 27, 2024 negative
LLMs primarily perform data retrieval and possess very little actual reasoning
“If it's text, they will regurgitate solutions to puzzles. They will, you know, give you answers to questions you may have. It's mostly retrieval. There's a very tiny bit of reasoning, but really not much and that's an important limitation.”