KV Cache Aware Routing

topic on 1 show · 1 statements across 1 episodes

No Priors

1 statements about KV Cache Aware Routing, every show

NO PRIORS Opinion

Srivastava: KV-cache-aware routing is already becoming old technology

“Even stuff like KV cache away routing and, you know, that stuff's a bit old now”

Tuhin Srivastava May 1, 2026 ▶ 29:04 Baseten CEO Tuhin Srivastava on Custom Models, and Building the Inference Cloud

← every entity, every show