Wang: AI labs underfund interpretability and deepfake detection for new capabilities
Alexandr Wang · Evaluating AI threats & opportunities (ScaleAI's Alexandr Wang & Intel’s Lama Nachman) · Jul 23, 2024 · at 48:03
Scale AI CEO Alexandr Wang discusses the technical challenges of combating deepfakes and the misalignment of research incentives across frontier AI labs.
0:00 / 0:37exact quote · 38.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The leading AI labs, you know, they're incentivized very much so to build Incredible new capabilities. But there's a lot of very important technical work and technical research that's been done in areas that are that are not building, you know, cooler capabilities, but are in, or in, you know, these areas like interpretability, or deepfake detection, or being able to properly you know defang some of these models, so you can't generate deepfakes in certain areas, and all these sorts of areas, you know, broadly speaking, scalable alignment, and research in that direction is, is not something that's sufficiently funded today.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Alexandr Wang
Wang: Humans will always hold a reasoning advantage in long-duration thought
“The areas where humans will always have a meaningful sort of reasoning or intelligence advantage relative to models is long form thought long duration thought, thinking over long time horizons.”
Wang: Generative AI will eliminate massive film visual effects budgets
“A lot of films now have, you know, tens of millions, hundreds of millions of dollar visual effects budgets. It's true. They won't have to spend that much on visual effects going forward. It'll be able to be done Much more automatically using these models”
Wang: AI will not displace high-end professional labor due to shortages
“This does not in itself result in, in labor displacement because most of these jobs that we're talking about are you know, there's a shortage of them in the economy. Most of the, most of these high end high end fields, you know, we need more doctors. We need m…”
Wang: Automotive outsourcing displaced 10% to 15% of American jobs
“Was the outsourcing of American automotive manufacturing. So you know, We used to have all this domestic automotive manufacturing, then it sort of slowly got outsourced to outside the United States. Over a few decade time period, it resulted in displacement of…”
Wang: Prompt engineering is as critical now as software engineering was
“Knowing how to interface with AI systems is an incredibly critical capability that is, I think is very akin to software engineering over the past few decades.”
Wang: Autonomous AI agents require 99.9% reliability to be commercially viable
“There's plenty of products like that that exists. They all suck because the models are nowhere close to reliable enough where you can actually depend on it to do any of those activities. And even if it has, let's say even a model has like 90% reliability, whic…”