synthetic data scaling
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Aug 28, 2024 by Arvind Narayanan · across every show →
Everything said about synthetic data scaling, oldest first
Aug 28, 2024 bearish
Narayanan: Recursive AI scaling using synthetic data will not work
“And the other way to look at synthetic data is, okay, you take one trillion tokens, you train a model on it, and then you output 10 trillion tokens, so you get to the next bigger model, and then you use that to output a hundred trillion tokens. You know, I'll …”