synthetic data generation
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Sep 5, 2024 by Andrej Karpathy · across every show →
Everything said about synthetic data generation, oldest first
Sep 5, 2024 neutral
Karpathy: Synthetic data risks silent distribution collapse without injected entropy
“When you're doing synthetic data generation, this is a problem, because you actually really want that entropy. You want the diversity and richness in your data set. Otherwise, you're getting collapsed data sets, and you can't see it when you look at any indivi…”