Inference Workload
topic on 1 show · 1 statements across 1 episodes
1 statements about Inference Workload, every show
Customer inference workloads rarely align with foundation model training distributions
“The data distribution in their inference workload doesn't align with the data distribution in the training data for the model, right? It's a given, actually. If you think about this, because researchers have to guesstimate what is important, what's not importa…”