looping
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Apr 2, 2026 by Mostafa Dehghani · across every show →
Everything said about looping, oldest first
Apr 2, 2026
Looping provides parameter-free FLOPS, whereas MoE architectures provide FLOPS-free parameters
“In mixture of experts, you have flops free parameters. So, so parameters that they're not actually bringing any flops. And in, in like looping, you have parameter free flops where you don't have extra parameters for the extra flops that you're throwing on this…”