Parameter Scaling
topic on 1 show · 1 statements across 1 episodes
1 statements about Parameter Scaling, every show
Zaharia: Model quality experiences diminishing returns from parameter scaling
“And also there's usually, there are usually diminishing returns from scale in, in terms of quality of models in general. And you can also kind of see it in other areas, like in computer vision, for example, we don't have, you know, trillion parameter models.”