backwards pass
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jun 18, 2026 by Stephen Balaban · across every show →
Everything said about backwards pass, oldest first
Jun 18, 2026
Balaban: Backwards pass accounts for two-thirds or more of training compute
“Generally speaking, when you're doing a training run, you might think that you might be some sort of split between the backwards pass and the forward pass on the model. And the backwards pass might be, let's say, two thirds or more of the compute and the forwa…”