Synthetic Data Scaling
topic on 1 show · 1 statements across 1 episodes
1 statements about Synthetic Data Scaling, every show
Narayanan: Recursive AI scaling using synthetic data will not work
“And the other way to look at synthetic data is, okay, you take one trillion tokens, you train a model on it, and then you output 10 trillion tokens, so you get to the next bigger model, and then you use that to output a hundred trillion tokens. You know, I'll …”