trillion parameters
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Apr 25, 2023 by Matei Zaharia · across every show →
Everything said about trillion parameters, oldest first
Apr 25, 2023 bearish
Zaharia: Trillion-parameter models are computationally inefficient for knowledge retrieval
“I think actually, I think from a computation perspective, it's very inefficient to have like a trillion parameters and have to actually load them all and add and multiply by them. Each time you make an inference, because they're just encoding knowledge, most o…”