model size
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jun 30, 2023 by Douwe Kiela · across every show →
Everything said about model size, oldest first
Jun 30, 2023 bullish
Douwe Kiela: Data size matters more than model size for AI performance
“It's just that data size matters even more than model size. And I think the Lama paper out of Meta really brilliantly showed this. Where if you train a smaller model on more data for longer, then you get a better model. So you get more bang for your buck if yo…”