ZeRO-3

1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jun 25, 2024 by Jonathan Frankle · said 1 times in 1 episodes since 2024 · across every show →

Mentions by year

tap a year for its mentions
0011112024episodesmentions
0112024episodes it came up in
000.50.5112024episodesmentions per episode
2024 1 mention in 1 episode

every mention, scene by scene, with the transcript →

Everything said about ZeRO-3, oldest first

Jun 25, 2024
Insight
Frankle: Training MoE models with FSDP creates severe network bandwidth bottlenecks
“And those models are very demanding when it comes to network bandwidth, at least if you're training them in kind of FSTP zero three style. Where there's just a lot of parameters getting shuffled back and forth and your ratio of kind of compute to amount of dat…”
Jonathan Frankle Jun 25, 2024 ▶ 39:59 State of the Art: Training 70B LLMs on 10,000 H100 clusters
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.