self-attention
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Apr 25, 2023 by Noam Shazeer · across every show →
Everything said about self-attention, oldest first
Apr 25, 2023 positive
Self-Attention Brought GPU Parallelism to Sequence Modeling
“The insight here was, Hey, you can use the same attention thing to like, look back at the past of the sequence that you're trying to produce. And you know, the beauty is that the, that It runs great on on GPUs and CPUs, and it's kind of parallel to, like, how …”