Unlabeled Data
topic on 1 show · 2 statements across 2 episodes
2 statements about Unlabeled Data, every show
Ethan He: Training generative video models on unlabeled data aids generalization
“For the generative model training, there's also really like a small percentage of unlabeled data. So, so the model is instructed to generate a video without any text instruction. That, that can also help the model generalize.”
Morcos: Modern AI capabilities depended entirely on self-supervised learning
“But I do not think there's any way we could get to where we are today without self-supervised learning and the ability to train on unlabeled data. That was the real advance to my mind that enabled us to get these incredible increases in capabilities.”