Transformer
also referred to as: transformers
5 statements across 5 episodes · 1 bullish · 1 bearish · 5 people on the record · first statement May 1, 2024 by Swami Sivasubramanian · said 6 times in 5 episodes since 2025 · across every show →
Mentions by year
brought up most by Alex Kantrowitz (4), Geoffrey Hinton (1), Demis Hassabis (1)
tap a year for its mentions
2026 3 mentions in 3 episodes 1 per episode
- OpenAI's Bots Break Containment and Hack Hugging Face Autonomously — With Alex Stamos
- AI Pioneer Geoffrey Hinton: AI Is Conscious, Superintelligence is Coming, And We Should Be Worried
- Google DeepMind CEO Demis Hassabis: AI's Next Breakthroughs, AGI Timeline, Google's AI Glasses Bet
- every mention in 2026, scene by scene →
Everything said about Transformer, oldest first
May 1, 2024 bullish
AWS AI Chief: AI architectures beyond pure transformers are absolutely necessary
“I actually think, ah, new architectures are absolutely necessary in the future, ah, and, ah, there are already hybrid architectures evolving. I mean, ah, I mean in terms of state space models to actually connectors hybrid models between state space to transfor…”
Jan 23, 2025 neutral
Demis Hassabis sees 50 percent chance AGI requires new architectural breakthroughs
“Maybe we need one or two more transformer-like breakthroughs. And I, and I'm, I think I'm genuinely uncertain about that. So that's why I say 50%. So I mean, I wouldn't be surprised either way if we got there with existing techniques and things we already knew…”
Apr 23, 2025 neutral
Patel: Standard transformers allocate identical compute to every generated token
“When you look at a transformer, every word is this, every token output, it has the same amount of compute behind it. Right. I E, you know, when I'm saying the versus sky is blue, the blue and the V have this or the is in the blue have the same amount of comput…”
Feb 6, 2026 bearish