Model Inference
topic on 2 shows · 2 statements across 2 episodes
2 statements about Model Inference, every show
Friedberg: Enterprise AI inference will split 70% major cloud, 20% local, 10% other
“I think you're going to end up being like, 70, 20, 10 in how you're going to allocate your resources for model inference and running models. You're going to probably be 70% in some big cloud. Maybe you'll do 20% local, 10% you'll try other clouds.”