AI training run
also referred to as: ai training runs
2 statements across 2 episodes · 0 bullish · 1 bearish · 2 people on the record · first statement Jun 10, 2020 by Jerome Pesenti · across every show →
Everything said about AI training run, oldest first
Jun 10, 2020 bearish
Pesenti in 2020: Multi-million-dollar AI training runs are unsustainable for Facebook
“Where it becomes millions is when you do training runs. So some of the training runs in the most advanced system that it comes from our company or other companies out there are starting to be extremely expensive. Yeah. Like you can look at one run in the scale…”
Jun 18, 2026
Balaban: Backwards pass accounts for two-thirds or more of training compute
“Generally speaking, when you're doing a training run, you might think that you might be some sort of split between the backwards pass and the forward pass on the model. And the backwards pass might be, let's say, two thirds or more of the compute and the forwa…”