Decoder Layer
topic on 1 show · 1 statements across 1 episodes
1 statements about Decoder Layer, every show
Ross: GPUs excel at LLM attention while LPUs excel at applying weights
“The LPU and GPU, as mentioned, they, they're better at different parts of what's, what's called the decoder layer of an LLM. The GPU is better at the attention portion, and the LPU is better at sort of applying the weights, which is the thing that gets trained…”