Heterogeneous Infrastructure
topic on 1 show · 1 statements across 1 episodes
the Y Combinator Startup Podcast
1 statements about Heterogeneous Infrastructure, every show
Smulyanski: AI inference demands heterogeneous hardware co-designed for different phases
“Inference Is a very heterogeneous workload, right? Different phases of inference exercise, compute, network, storage, memory bandwidths differently, and so when we look at it makes sense to actually co-design the systems that will opt to, you know, use differe…”