dense architectures
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement May 24, 2026 by Omar Sanseviero · across every show →
Everything said about dense architectures, oldest first
May 24, 2026 neutral
Sanseviero: Embedding offloading suits edge devices; larger models require MoEs or dense architectures
“This is really optimized and designed for, like, on-device. And when I say on-device, I mean, like, running in a phone, Android, Raspberry Pi, and so on, right? When you go larger, you usually want to come back more You want to have more, like, dense architect…”