Inferencing Capacity
topic on 1 show · 1 statements across 1 episodes
1 statements about Inferencing Capacity, every show
Microsoft uses idle nighttime inference capacity for global AI post-training
“What's nice about post training is that you don't have to do it in one large data center in one location. And so part of the technique that we've been focused on is how do we take this inferencing capacity around the world? And a lot of it is idle at night as …”