Inference Engineering
topic on 1 show · 1 statements across 1 episodes · said 2 times in 1 episodes since 2026
Mentions by year, every show
tap a year for its mentions
Latent Space 2
every mention on every show, scene by scene, with the transcript →
1 statements about Inference Engineering, every show
Local AI optimizes for memory fit; data centers optimize for speed
“The difference between inference engineering for the data center and for production workloads versus inference engineering for local AI is that we start with fundamentally like different constraints and different goals. With local AI, it's how do I fit this mo…”