Trillion Parameters
topic on 1 show · 1 statements across 1 episodes
1 statements about Trillion Parameters, every show
Zaharia: Trillion-parameter models are computationally inefficient for knowledge retrieval
“I think actually, I think from a computation perspective, it's very inefficient to have like a trillion parameters and have to actually load them all and add and multiply by them. Each time you make an inference, because they're just encoding knowledge, most o…”