Small Language Models
topic on 5 shows · 5 statements across 5 episodes
Innovators & Investors 
Latent Space 
No Priors 
Sourcery 
All-In
5 statements about Small Language Models, every show
Kurtz: CrowdStrike uses internal SLMs and guardrails when leveraging LLMs
“We, well, we have our small language models, and we do work with just about all of the large language models. But we've built our own guardrails around what gets shared, how it gets shared, and how we process any of the data back.”
OptimaEd Uses SLMs and LLMs to Power VR Teaching Avatars
“We're now using small language models and even large language models to power The avatars that are teaching about these particular subjects.”
Tunguz: 100x cost difference between small and largest AI models
“I was just looking at the analysis between the smallest models, which are about four or two to four billion parameters, and the very largest models, which about four or fifty billion parameters, you have a hundred X difference in inference costs.”
Ben Allal: Distilling from large models avoids small-model self-training collapse
“I think if you do that approach, it's normal to observe this kind of behavior because the quality is going to be worse because the model is already small, and then if you train it just on these generations, you shouldn't expect it to become better. But what we…”