Wang: Pure synthetic AI training data has underperformed industry expectations
Alexandr Wang · AI Predictions for 2025: Geopolitics, Agents, and Data Scaling — With Alexandr Wang · Dec 11, 2024 · at 44:46
Alexandr Wang, CEO of Scale AI, discusses AI model data training techniques with Big Technology host Alex Kantrowitz.
0:00 / 0:17exact quote · 18.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“One of the things that we've seen over the past few past year in particular is that synthetic data has not worked as well as I think everybody had hoped. You know, pure synthetic data, just using data generated from the models to try to train future models, that can sometimes cause real issues for the models.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Alexandr Wang
Wang: Military AI will function as deterrence and prevent conflicts
“My hope certainly is that while AIs Application into military is something that is, is very concerning and potentially extremely powerful. It is the sort of same overall effect, which is to ultimately deter more conflict than create it.”
Wang: US must possess superior AI to prevail in conflict with China
“If you believe that there's some potential of some kind of conflict over Taiwan or other, some kind of other, like, hot conflict between the US and China then we really, the United States needs to ensure that we have the best possible AI technology to ensure t…”
Wang: US leads China in AI algorithms and compute, but data contested
“If we were to rack and stack versus China, we're ahead on algorithms. We're ahead on compute computational power, thankfully due to a lot of the export controls that the commerce department has put in place. And then on data, it's a little bit of a jump ball.”
Wang predicts China will deploy military AI faster than the US
“So, my expectation is that they will actually deploy AI to their military faster than the U.S., even though the U.S. Is ahead on the core technology.”
Wang: China's DeepSeek produced the first replication of OpenAI's o1 model
“OpenAI released O-one and released the O-one preview a number of months ago... Yeah, this is OpenAI's advanced reasoning model, which is great at sort of scientific reasoning and mathematical reasoning and reasoning and code, et cetera. And the very first repl…”
Wang: US chip export controls successfully hamper China's frontier AI development
“There is a very real hamper in a lot of their progress too, which is the chip export controls. And this has been an incredible effort, I think, from the U.S. Department of Commerce and the, you know, the Biden administration in general to sort of hamper the ab…”