RadixAttention
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jan 19, 2025 by Yining Zhang · said 2 times in 1 episodes since 2025 · across every show →
Mentions by year
tap a year for its mentions
Everything said about RadixAttention, oldest first
Jan 19, 2025 positive
Zhang: SGLang achieves higher cache hit rates using block size of one
“Redix cache, I think it's the technology of the prefix caching, and it is a special case for something like block size is one, you know, for VLM or for other frameworks, they use something block size, 32, and SGLAN use the block size one. I think if you use th…”