ZeRO-3, every mention
1 scene · ← back to ZeRO-3
tap a year for its mentions
Verbatim, from the transcripts: the passages where ZeRO-3 comes up
State of the Art: Training 70B LLMs on 10,000 H100 clusters
- ▶ 32:23 unnamed speaker I noticed also in the piece that you mentioned FSTP with zero three, um, actually when we met, um, I went to iClear and, uh, Guanhua from the DSP team was, was there presenting zero plus plus.