reinforcement learning infrastructure
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jul 31, 2025 by Nathan Lambert · across every show →
Everything said about reinforcement learning infrastructure, oldest first
Jul 31, 2025 negative
Lambert: Long inference generations break RL infrastructure and require more GPUs
“The inference, high inference length generations definitely just, like, kind of breaks all infrastructure, because there's just so many tokens, there's more opportunity for out of memory or other things to go wrong. So it's like, just on a default, all of your…”