multi-head latent attention
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement May 31, 2024 by Mark Huang · across every show →
Everything said about multi-head latent attention, oldest first
May 31, 2024 positive
Huang: DeepSeek's Multi-Head Latent Attention is novel and underrated
“Underrated specific instance would be, like, the deep seek paper. I'd never seen it before, but, like, the multi-head latent attention, like, that was really unexpected to me because, like, I thought I'd seen every Not every type, obviously, but, like, every w…”