diffusion language models

4 statements across 2 episodes · 3 bullish · 0 bearish · 2 people on the record · first statement Aug 4, 2025 by Stefano Ermon · across every show →

Everything said about diffusion language models, oldest first

Aug 4, 2025 positive

Insight

Ermon: Diffusion LLMs gain speed by modifying multiple tokens in parallel

“That's kind of like the reason diffusion, diffusion language models are much faster compared to autoregressive models. Is that each neural network evaluation doesn't just give you one token, like in the typical autoregressive world, but it's able to Output, es…”

Stefano Ermon Aug 4, 2025 ▶ 5:05 ⚡️Mercury: Ultra-Fast Diffusion LLMs — Estefano Ermon, CEO Inception Labs

Aug 4, 2025 bullish

Disclosure

Inception Labs develops specialized DPO algorithm for diffusion language models

“We have a DPO algorithm specialized for diffusion language models.”

Stefano Ermon Aug 4, 2025 ▶ 13:05 ⚡️Mercury: Ultra-Fast Diffusion LLMs — Estefano Ermon, CEO Inception Labs

Jul 21, 2026 bullish

Assertion Supported

Wang: Diffusion Outperforms Autoregressive Models on Unseen Cellular Tasks

“We find that switching from autoregressive training to division language models give a significant improvement over some of the harder tasks, particularly generalized to unseen tasks.”

Bo Wang Jul 21, 2026 ▶ 52:00 🔬Causal Models Need Causal Data - Xaira’s X-Cell model (Bo Wang & Ci Chu)

Jul 21, 2026

Insight

Wang: Autoregressive Models Type Sequentially, Diffusion Models Iteratively Edit

“What's the difference between autoregressive training versus diffusion language models is that it kind of, you can think of autoregressive training as typing. There is, for example, I like coffee, you have to type I, and then like, and coffee. There's inherent…”

Bo Wang Jul 21, 2026 ▶ 42:53 🔬Causal Models Need Causal Data - Xaira’s X-Cell model (Bo Wang & Ci Chu)

diffusion language models

Everything said about diffusion language models, oldest first

Turn any episode into a week of clips.