Ibarra: Running multiple AI vendor bake-offs wastes time instead of saving money
Amelia Ibarra · 6 Months Later, How Our AI SDRs Actually Work as AI Runs GTM with SaaStr's CEO and Chief AI Officer · Nov 21, 2025 · at 57:56
Amelia Ibarra of SaaStr discusses AI tool evaluation strategies during a webinar Q&A, responding to a CMO running ten concurrent vendor trials.
0:00 / 0:26exact quote · 27.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Like, I think in trying to save money, you're actually spending a lot more time than you normally would just deploying these and getting the outputs of AI by doing these 10 different betas. I was like, just pick one, and if you feel like the cost It's prohibited. Work with the vendor on the cost. See what they can do for you. If not, go to, fine, go to their competitor if you need to. But I was like, don't do 10 trials because you think it's going to magically save you money in the end on AI.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Amelia Ibarra
Ibarra: AI-native GTM agencies are selling snake oil
“There's no agency that already knows how to do this. There's no, maybe there's a few like ester people at orgs that you can try and steal. But outside of that, I wouldn't, you know, buy the snake oil of, oh, we're an AI native agency and we know how to do GTM …”
Ibarra: Claude autonomously added unauthorized guardrails to SaaStr's contract workflows
“The agent with Fable, since it was on for so long, decided in the last week, I don't know where along the road, It would exclude some things in our Panadoc that it thought might be an NDA or a non-binding like sales contract.”
Ibarra: SaaStr AI agent Tenke holds budget and decides vendor renewals
“Literally, Tenke is going to decide for you, and if it says no, I'm going to say no. Like, for this, he has the budget. Like, he can decide if he wants to use this or not.”
Ibarra: Every new AI agent requires a two-week blackout period
“Even with the help we get, like, I feel like every new agent costs us at least two weeks of what I call either a blackout period and somewhat chaotic of, like, I kind of have to ignore the other agents anytime I bring on a new agent”
Ibarra: AI agents idle and waste money without daily human management
“You can't, you, it just can't afford to wait a whole week, or like you're, or you're probably just wasting, honestly, you're probably wasting your money if you don't spend the time to do it daily, because a lot of these are waiting for you to give it inputs, r…”