Latent MoE
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jul 2, 2026 by Bryan Catanzaro · across every show →
Everything said about Latent MoE, oldest first
Jul 2, 2026 positive
Catanzaro: Nemotron 3's Latent MoE quadruples experts for same inference cost
“Latent MOE is a specific innovation that we have in NemoTron three family. And what it does is actually reduces the amount of communication that has to be sent through NVLink during MOE computations by basically down projecting it. So, you know, every token pr…”