transformer models
also referred to as: transformer model
3 statements across 3 episodes · 2 bullish · 1 bearish · 3 people on the record · first statement Feb 23, 2023 by Gary Marcus · across every show →
Everything said about transformer models, oldest first
Feb 23, 2023 negative
Marcus: Pure transformer models lack mechanisms for truth and inherently hallucinate
“If you look at a completely pure case of a transformer model trained on a bunch of data, It doesn't have any mechanisms for truth. Now, except the sort of accidental contingency, and there are inherent reasons why these systems hallucinate, and maybe I can, in…”
Sep 6, 2023 positive
Ramaswamy: Google open-sourced Transformers in 2017 to prevent top researchers from leaving
“If you had told these people at that time that they could not publish, they would have gone and worked for universities, they would have gone and worked for Microsoft, they would have gone and worked for other people.”
Jul 7, 2026 positive
Kutylowski: Task-specific AI models outperform general LLMs due to dedicated parameter capacity
“When they're made for different purposes, they also lose a little bit of the capability that they had maybe initially when they've been made for translation only. This The set of parameters that is available there, this, which kind of determines quite often th…”