Forward Pass
topic on 1 show · 1 statements across 1 episodes
1 statements about Forward Pass, every show
Lambert: Autoregressive LLMs lack explicit internal structures for intermediate state
“Language models have no ability to do this. They are. Kind of per token computation devices where each token is outputted after doing this forward pass and within that there's no explicit structure to hold these intermediate states.”