LLM Training Primitives
topic on 1 show · 1 statements across 1 episodes
1 statements about LLM Training Primitives, every show
Frankle: Fault tolerance is missing from fundamental model training primitives
“Fault tolerance is still not really built into any of the fundamental primitives of training models. And so if something breaks, you have to go figure out what broke your job stops. You have to restart your job. It is a nightmare just to get to the point where…”