Sands: Stripe chose Braintrust for AI evaluations over two dozen vendors
Emily Glassberg Sands · The Agents Economy Backbone - with Emily Glassberg Sands, Head of Data & AI at Stripe · Oct 30, 2025 · at 1:13:40
Emily Glassberg Sands, Head of Data & AI at Stripe, describes Stripe's 'Spotlight Program' for issuing RFPs to procure external AI tooling instead of building internally.
0:00 / 0:18exact quote · 18.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So we actually had like more than two dozen applicants for this evals RFP. Shawn 'Swyx' Wang: There's no way you can evaluate all of them. Emily Glassberg Sands: Well, we actually, we did. So they wrote like nice one pagers. We read them all. We narrowed it down to two finalists. Brain Trust ended up winning. We did a POC with them. They rock. We stuck with them.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Emily Glassberg Sands
Sands: Top 100 AI startups on Stripe have unprecedented revenue per employee
“When you look at most of the top hundred AI companies on Stripe, their revenue per employee is Unlike any other business, including public companies who are known for being incredibly efficient companies.”
Sands: AI Agents Will Make Fraud Decisions Within Six Months
“Now you can think about, okay, actually foundation model, text alignment, like human readable description of like why we're worried about this charge. And then today, a human tomorrow, an agent sitting on top of that and decisioning, like reasoning over The mo…”
Sands: Agentic commerce will expand total consumption by removing time constraints
“The biggest cost to very high-income people consuming is not the dollar cost, it's the time cost of consumption, and so I'm very interested in how agentic commerce can Open the aperture for spending by high-income people because it's removing the most costly o…”
Sands: Enterprises should measure AI adoption on 2-3 year ROI
“When I think about the optimal adoption of these AI tools, it seems wrong to focus on in-year ROI, and it seems right to focus on two-year, three-year ROI. Now, inherently hard to know what two or three years is gonna look like, but if we look at the history, …”
Sands: Static dashboards will be obsolete within nine months as agents take over
“I think the value of near real time, high quality, well documented data is about to skyrocket because I'm pretty sure that nine months from now, no one is going to want to go and like look at a even like static dashboard and click around. They're going to want…”
Sands: Stripe passed on Tecton, co-building Cronon with Airbnb for latency
“We evaluated Tekton. This was a couple of years ago now. At the time, we couldn't wrap our heads around using it on the charge path, just from like a latency and reliability perspective. Like we've got to be operating at six nines. We got to be like, Decisioni…”