AI training data
4 statements across 3 episodes · 2 bullish · 0 bearish · 3 people on the record · first statement Feb 8, 2024 by Ce Zhang · across every show →
Everything said about AI training data, oldest first
Feb 8, 2024 positive
Zhang: Pre-training data evolved from a model byproduct into a standalone asset
“So, so I think one fundamental thing that changed in the last year, essentially, in the beginning when people think about data, is, is always like a byproduct of the model, right? You release the model, you also release the data, right? The data side is there …”
Feb 8, 2024 positive
Zhang: The world is not running out of AI training data
“I don't think we are running out of data on earth. Right, so think about it globally... But I do think there are many organizations in the world have enough data to actually train, like, very, very good models, right? So, I mean, they are not public available,…”
Aug 29, 2025
Morcos: A data point's value depends on its relationship to the full dataset
“The easiest way to think about this is that the value of a data point is not just a function of that data point itself. It's rather a function of how that data point relates to every other data point in the training set, right?”
Dec 30, 2025
Catanzaro: AI Data Prep Workloads Are Far Less Predictable Than BI Analytics
“I think one of the things that we saw with analytics that, you know, was surprising to some of the people in the data infrastructure space was that, like, the workloads were actually quite predictable. They were quite predictable because, like, many of them we…”