Transformer

2 statements across 1 episodes · 1 bullish · 1 bearish · 1 people on the record · first statement Aug 25, 2026 by Neil Movva · said 1 times in 1 episodes since 2026 · across every show →

Mentions by year

brought up most by Patrick O'Shaughnessy (1)

tap a year for its mentions
0011112026episodesmentions
0112026episodes it came up in
000.50.5112026episodesmentions per episode

every mention, scene by scene, with the transcript →

Everything said about Transformer, oldest first

Aug 25, 2026 negative
Insight
The 'Original Sin' of Transformers Is Pairing Memory-Bound and Compute-Bound Layers
“And I would say the original sin of Transformers is that you've taken this extremely fundamentally memory bound layer and juxtaposed it right next to a compute bound layer. It is very difficult to have a single chip that is good at both compute operations and …”
Neil Movva Aug 25, 2026 ▶ 31:43 Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
Aug 25, 2026 positive
Insight
Movva: Transformers scale well because they impose no human priors
“What transformers really did well is that they scaled. Transformers make no such human prior. Transformers just say, well, there's gonna be a pattern in the sequence of data, and if there is a pattern, I'm gonna find it.”
Neil Movva Aug 25, 2026 ▶ 33:36 Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 60 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.