Wang: Autonomous AI agents require 99.9% reliability to be commercially viable
Alexandr Wang · Evaluating AI threats & opportunities (ScaleAI's Alexandr Wang & Intel’s Lama Nachman) · Jul 23, 2024 · at 25:32
Scale AI CEO Alexandr Wang explains why current autonomous consumer AI products fail and the extreme reliability required before users will trust AI to execute transactions.
0:00 / 0:32exact quote · 32.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“There's plenty of products like that that exists. They all suck because the models are nowhere close to reliable enough where you can actually depend on it to do any of those activities. And even if it has, let's say even a model has like 90% reliability, which in machine learning for these models would be like incredibly high. If for a user one in every 10 times it like creates a wrong charge in your credit card or books the wrong thing, or Books the wrong flight. That's extremely frustrating, and you're just not going to use the product. So it has to get to almost, like, 99.9% reliability.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Alexandr Wang
Wang: Humans will always hold a reasoning advantage in long-duration thought
“The areas where humans will always have a meaningful sort of reasoning or intelligence advantage relative to models is long form thought long duration thought, thinking over long time horizons.”
Wang: Generative AI will eliminate massive film visual effects budgets
“A lot of films now have, you know, tens of millions, hundreds of millions of dollar visual effects budgets. It's true. They won't have to spend that much on visual effects going forward. It'll be able to be done Much more automatically using these models”
Wang: AI will not displace high-end professional labor due to shortages
“This does not in itself result in, in labor displacement because most of these jobs that we're talking about are you know, there's a shortage of them in the economy. Most of the, most of these high end high end fields, you know, we need more doctors. We need m…”
Wang: AI labs underfund interpretability and deepfake detection for new capabilities
“The leading AI labs, you know, they're incentivized very much so to build Incredible new capabilities. But there's a lot of very important technical work and technical research that's been done in areas that are that are not building, you know, cooler capabili…”
Wang: Automotive outsourcing displaced 10% to 15% of American jobs
“Was the outsourcing of American automotive manufacturing. So you know, We used to have all this domestic automotive manufacturing, then it sort of slowly got outsourced to outside the United States. Over a few decade time period, it resulted in displacement of…”