Data Size
topic on 1 show · 2 statements across 2 episodes
2 statements about Data Size, every show
Rouif: AI data quality is more important than data size
“On data, what matters is quality more than size”
Douwe Kiela: Data size matters more than model size for AI performance
“It's just that data size matters even more than model size. And I think the Lama paper out of Meta really brilliantly showed this. Where if you train a smaller model on more data for longer, then you get a better model. So you get more bang for your buck if yo…”