MobileLLM
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Dec 24, 2024 by Loubna Ben Allal · said 3 times in 3 episodes since 2024 · across every show →
Mentions by year
brought up most by Shawn Wang (1), Loubna Ben Allal (1)
tap a year for its mentions
2024 3 mentions in 3 episodes 1 per episode
Everything said about MobileLLM, oldest first
Dec 24, 2024 positive
Meta research: Sub-1B language models benefit more from depth than width
“For example, they find that depth is more important than width, so it's more important to have models that have, like, more layers than just making them more wide. They also find that GQA helps, that tie-in the embedding helps, so I think it's a nice study ove…”