Mulchandani: AI tools risk amplifying intelligence analysts' cognitive biases
Nand Mulchandani · Intelligence in the Age of AI with new CTO of the CIA · Mar 11, 2024 · at 10:53
Nand Mulchandani, CTO of the CIA, explains the risk of push-model AI analytics reinforcing human bias.
0:00 / 0:16exact quote · 16.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Well, it can then also, unfortunately, take the things that you as an analyst are weakest at, or it's your weak knee or your thing that, that it can get into your head. And start rabbit-holing you down this thing, which amplifies your biases.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Nand Mulchandani
Mulchandani: CIA has deployed large language models for open-source intelligence
“We're public with the fact that we actually have LLMs in production at the agency. We have it in production in the open source team.”
Mulchandani: Deploying battle-ready AI in defense will take a long time
“So it's funny because like the excitement and hype about this technology versus us absorbing it and making it battle ready is a long, long distance. And so I don't, I'm hopefully, you know, portraying or representing that side of the equation, which it doesn't…”
Mulchandani: AI use in spy operations will continuously escalate
“The democratization of this stuff and the availability we know is going to drive each one of our competitors to be driving this up. We're going to be aware of that. We're going to drive our own stuff up. So there's this aspect of, we don't know where this is g…”
Mulchandani: AI forces explicit decision-making around probabilistic output thresholds
“With these newer algorithms these are still probabilistic algorithms. Except now the probabilities actually stare you in the face in a way that previous systems didn't push, right? So previous application systems never came up with said, do you want the 49%, t…”
Mulchandani: CIA lacks the compute cycles to modify open-source AI weights
“Anybody's ability to do something with that, those, with that information is limited, because it's not just the numbers. You have to have the expertise you need to Compute. You need all the other pieces. That's my point, which is great. I have that information…”