Auto Regressive Transformers

topic on 1 show · 1 statements across 1 episodes

the MAD Podcast

1 statements about Auto Regressive Transformers, every show

MAD Opinion
Text diffusion models will not replace autoregressive Transformers at state-of-the-art
“So it is a interesting direction to go into these diffusion, diffusion models as alternative to the auto regressive transformers, but it is not I would say the replacement at the state of the art.”
Sebastian Raschka Jan 29, 2026 ▶ 12:57 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.