Active Parameters
topic on 1 show · 1 statements across 1 episodes
1 statements about Active Parameters, every show
Cameron: Inference economics incentivize larger, sparser AI models over dense architectures
“It's, I think, less about total parameters in many cases when thinking about inference costs and more around number of active parameters, and so there's a bit of an incentive towards larger, sparser models.”