efficient attention
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jan 23, 2026 by Yi Tay · across every show →
Everything said about efficient attention, oldest first
Jan 23, 2026 neutral
Yi Tay: Efficient attention research consistently failed to eliminate self-attention
“There was this whole big era, which I was also involved in this era, where people try to like undermine the attention as much as possible. Like they try to remove it, simplify it, make it efficient, like this whole Like, efficient attention era. At the end of …”