batch size
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jul 22, 2026 by Eiso Kant · across every show →
Everything said about batch size, oldest first
Jul 22, 2026 neutral
Kant: RL compute cannot scale like pre-training due to task batch constraints
“And RL is batch size constraint, right? So like you are ultimately in your batch size constraint because you don't have infinite tasks, right? When you've got the entire web, you can be much more flexible in scaling up your batch size because you've got the en…”