decoder layer
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jul 5, 2026 by Jonathan Ross · across every show →
Everything said about decoder layer, oldest first
Jul 5, 2026
Ross: GPUs excel at LLM attention while LPUs excel at applying weights
“The LPU and GPU, as mentioned, they, they're better at different parts of what's, what's called the decoder layer of an LLM. The GPU is better at the attention portion, and the LPU is better at sort of applying the weights, which is the thing that gets trained…”