70 Billion Parameter Models
topic on 1 show · 1 statements across 1 episodes
1 statements about 70 Billion Parameter Models, every show
Lambert: Scaling from 7B to 70B parameters fixes nuance and repetition
“I think the things that people see now is like the small models don't really handle nuance as well, and they could be more repetitive if, even if they have really good instruction tuning, but if you take that kind of seven to seventy billion parameter jump, li…”