Crivello: Lindy will likely switch to Braintrust for AI evaluations
Florent Crivello · Agents @ Work: Lindy.ai (with live demo!) · Nov 15, 2024 · at 28:44
Florent Crivello is the founder and CEO of Lindy.ai, discussing their internal evaluation infrastructure with hosts Alessio and Swyx.
0:00 / 0:02exact quote · 2.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We're most likely going to switch to Braintrust.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Florent Crivello
Crivello: WordPress is a commercial failure despite powering 60% of the web
“WordPress is a commercial failure. They run 60% of the internet, and they're, like, a fraction of the size of even Substack, right?”
Crivello: Tech workers outside SF lack judgment or ambition
“I think at this point, if you are in tech, especially in AI, but if you're in tech and you're not in San Francisco, you either lack judgment or you lack ambition. It's one of the two.”
Crivello: Lindy AI agents perform better than humans for most use cases
“I think the bar is it needs to be better than a human. And for most use cases we serve today, it is better than the human, especially if you put it on rails.”
Crivello: OpenAI's GPT-4o Is Overhyped and Poor for Agents
“I think four O is overhyped. Frankly, we don't use four O. I don't think it's good for agentic behavior.”
Crivello: Every major remote success story lost to an in-person competitor
“In every one of these examples, you have a co-located counterfactual that is sometimes orders of magnitude bigger.”
Crivello: Remote work optimizes for cost; building creative software requires in-person collaboration
“If you're optimizing for cost, absolutely be remote. If you're optimizing for creativity, which I think that software and product building is a creative endeavor, if you're optimizing for creativity, it's kind of like composing an album. You can't do it on the…”