LLM training primitives
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jun 25, 2024 by Jonathan Frankle · across every show →
Everything said about LLM training primitives, oldest first
Jun 25, 2024 negative
Frankle: Fault tolerance is missing from fundamental model training primitives
“Fault tolerance is still not really built into any of the fundamental primitives of training models. And so if something breaks, you have to go figure out what broke your job stops. You have to restart your job. It is a nightmare just to get to the point where…”