Diffusion Transformers
topic on 2 shows · 3 statements across 2 episodes
3 statements about Diffusion Transformers, every show
Ethan He: Diffusion transformer training closely mirrors LLM training architecture
“So now the training, training of the diffusion transformer, you already generated models use diffusion transformers. It is actually quite standard. It's very similar to how you train a language transformer models. It's not that much difference. It's just the t…”
Doshi: Diffusion Transformers Alone Lack Utility Without Integrated Language Models
“Transformers are definitely, I think transformers are definitely like the right direction, but I don't think that we're going to get a lot of you enough utility if we're not like somewhat trying to figure out a way to combine the great, amazing knowledge of li…”