Sivulka: Human-in-the-loop guidance is essential for useful outlier detection
George Sivulka · AI and the Future of Knowledge Work with Hebbia’s CEO George Sivulka · Jun 21, 2023 · at 28:55
George Sivulka, CEO of Hebbia, addresses whether AI should automatically surface insights, arguing that context and human framing are necessary for relevant findings.
0:00 / 0:37exact quote · 37.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Like, if I just took a data set and I said, here are all your outliers, it's actually less helpful than saying, hey, across this principal component, I want to know what's an outlier. And so kind of back to the whole human in the loop paradigm, I think it's very important to have a human in the loop and say, hey, like, I need to compare these two documents, or I need to know what documents don't have this right legal clause in them, and then I have to go and renegotiate those contracts, or something like that. And that's stuff that Hebbia can do and already does. It can alert you when stuff isn't right or out of domain, but you still have to kind of provide the principal component of meaning that you want to check that on.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from George Sivulka
Generalized AI software will defeat vertical AI specialization
“One of the things that is a massive fallacy in AI applications today is verticalization. As paramount. All of the VCs, a lot of entrepreneurs as well, believe, because it's been true for the last 20 years, that building a very verticalized piece of software is…”
AI hallucinations are old news; modern models outperform humans
“I think it's old news. And I think the only reason we still talk about it, it's like everyone talks about hallucinations and, you know, no one knows if it's happening or what's going on. It's like fugazi fugazi. Like, it was a problem back when the models were…”
The alpha is gone for starting new AI companies today
“I don't mean to be relatively pessimistic, but I wouldn't start a company in AI. I mean that from the perspective of, like, the alpha is gone.”
Sivulka is "very short" Accenture, consultancies, and the Big Four
“I'm very short Accenture and consultancies, but and the big four.”
Hybrid teams of humans and AI agents will dominate organizational structures
“You're going to start to have, you know, fully human organizations. Actually fully AI organizations like the one person billion dollar startup or, you know, these things that are effectively just APIs. And you'll actually have, and this will be the most common…”
Prompting AI agents will soon become synonymous with management
“As agents are rolled out, you'll actually start to see you know, people that are really good at prompting, really good at defining a process, be the best managers, and actually be the best at extending whatever their agenda is in the organization, or making th…”