Lama Free
part of Lama
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jul 23, 2024 by Thomas Scialom · across every show →
Everything said about Lama Free, oldest first
Jul 23, 2024 positive
Scialom: Smaller Llama 3 models improved via distillation from 405B
“Having bigger models enables to collect better data, for instance, at RLHF stage, because that's the model we use for the annotation. And so we distillate straight forward, like those annotations from this better model to the other models. So I can guarantee y…”