encoder-decoder
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jul 5, 2024 by Yi Tay · across every show →
Everything said about encoder-decoder, oldest first
Jul 5, 2024 positive
Tay: Encoder-decoders provide 2x parameter capacity at matched FLOPs
“The only big benefit of encoder decoders
[4425] Yi Tay: Is that it has this thing called, like, I mean, what I like to call intrinsic sparsity.
[4430] Podcast Host: Ok.
[4431] Yi Tay: So basically, an encoder decoder with, like, n baramps is, like, basically, …”