on-device AI
2 statements across 2 episodes · 1 bullish · 0 bearish · 2 people on the record · first statement Aug 7, 2024 by Nikhila Ravi · across every show →
Everything said about on-device AI, oldest first
Aug 7, 2024 bullish
May 24, 2026 neutral
Sanseviero: Embedding offloading suits edge devices; larger models require MoEs or dense architectures
“This is really optimized and designed for, like, on-device. And when I say on-device, I mean, like, running in a phone, Android, Raspberry Pi, and so on, right? When you go larger, you usually want to come back more You want to have more, like, dense architect…”