Triangle Layers
topic on 1 show · 1 statements across 1 episodes
1 statements about Triangle Layers, every show
McPartlon: Triangle layers run inefficiently on modern GPU architectures
“These layers are pretty costly and like that kind of limits what you can do with the architectures. They're not like, Not only are they like costly in terms of compute, they're just like not efficient on modern GPUs either. You have small hidden dimensions, la…”