generated data
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Aug 24, 2023 by Jakob Uszkoreit · across every show →
Everything said about generated data, oldest first
Aug 24, 2023 bullish
Uszkoreit: Training on synthetic data works by amortizing generation compute
“And ironically, and this comes back to a question that many people ask, I think around, does it make any sense to train on generated data? Because information theory, family information theory, very clearly says, nope, you're not going to get more information …”