Multi Node Training
topic on 1 show · 1 statements across 1 episodes
1 statements about Multi Node Training, every show
Bubna: Modal multi-node training targets post-training, not large-scale pre-training
“And we're not going for obviously like large scale pre-training runs. The thing that we've built multi-handle training for is we see a lot of smaller scale post-training like people are post-training like medium-sized fun models so they can get higher quality …”