forward pass
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jan 2, 2025 by Nathan Lambert · across every show →
Everything said about forward pass, oldest first
Jan 2, 2025 neutral
Lambert: Autoregressive LLMs lack explicit internal structures for intermediate state
“Language models have no ability to do this. They are. Kind of per token computation devices where each token is outputted after doing this forward pass and within that there's no explicit structure to hold these intermediate states.”