Decoder Only Model
topic on 1 show · 1 statements across 1 episodes
1 statements about Decoder Only Model, every show
Tay: Encoder-decoders provide 2x parameter capacity at matched FLOPs
“The only big benefit of encoder decoders
[4425] Yi Tay: Is that it has this thing called, like, I mean, what I like to call intrinsic sparsity.
[4430] Podcast Host: Ok.
[4431] Yi Tay: So basically, an encoder decoder with, like, n baramps is, like, basically, …”