Network Width
topic on 1 show · 1 statements across 1 episodes
1 statements about Network Width, every show
Gaur: Scaling depth is more parameter- and sample-efficient than width in RL
“But when you look at the number of parameters that your network has as you grow with, it's roughly a quadratic as opposed to something like growing depth, so it's more, in some sense, it's more parameter efficient, also more sample efficient from the experimen…”