Crivello: AI agents must be benchmarked against humans, not software
Flo Crivello · What AI and LEGO Have in Common | Flo Crivello on TBPN April 7th · Apr 10, 2025 · at 17:34
Lindy founder Flo Crivello discusses how enterprises should evaluate the reliability of autonomous customer-facing AI agents.
0:00 / 0:03exact quote · 3.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Agents, the comp is not other software, it's humans, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Flo Crivello
Crivello: Meta AI VP and Researchers Resigned Over Unethical Practices
“The VP of AI research at Meta resigned and so have a couple members of the core research team seemingly in protest for what they deemed to be unethical practices.”
Crivello: Meta's Llama 4 Has Good Evals but Bad Vibes
“I will say, I feel bad for saying that because I have friends like the Lama team, but boy, like Lama for the vibes are really bad. Like the emails are good and the vibes are quite bad actually.”
Crivello: Zuckerberg Threatened to Fire Meta AI Org Over Targets
“I think Zach is, is massively raising the temperature and I think he's basically threatened to like Destroy the whole org or, like, fire happy org or, like, similar stuff like that if they don't hit certain targets by a certain date, and I think that's led to …”
Crivello: High-revenue enterprise AI startups are becoming modern shelfware
“There are some very hot AI startups out there in the enterprise that are basically shelfware. Like, their revenue is skyrocketing, and they're meeting very little adoption internally.”
Crivello: Bearish on consumer AI agents because consumers are time-rich and money-poor
“I am actually quite bearish for consumer agents. I think, like, consumers are time rich and money poor, right? It's like, they don't want to trade time for money like that, which is why I think, like, Google Assistant and Alexa, like, they've been really failu…”
Crivello: Drop-in AI worker replacements for businesses will arrive in 12-18 months
“I think, like, there is going to be a transformational moment for businesses where you have, like, the holy grail of AI agencies, like, what we call the drop-in replacement for a human worker. And I think that's coming in, like, 12 to 18 months.”