parameter scaling
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Apr 25, 2023 by Matei Zaharia · across every show →
Everything said about parameter scaling, oldest first
Apr 25, 2023 bearish
Zaharia: Model quality experiences diminishing returns from parameter scaling
“And also there's usually, there are usually diminishing returns from scale in, in terms of quality of models in general. And you can also kind of see it in other areas, like in computer vision, for example, we don't have, you know, trillion parameter models.”