Franceschi: LLMs Mask How Much Training Data Supported Your Specific Query
Pedro Franceschi · The Most AI-Pilled CEO We Know · Y Combinator · Jun 10, 2026 · at 24:52
Brex co-founder Pedro Franceschi discusses the limitations of relying on large language models without visibility into their underlying dataset distribution.
0:00 / 0:10exact quote · 10.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And I think the biggest pitfall of LMs is you have no sense of How much training data the model has seen for the exact thing that you're asking it.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Pedro Franceschi
Franceschi: Startups Should Begin as Single-Person Companies with High AI Spend
“If I were to start a company today, I would say, okay, the premise is why can't it be just me? Like, and then you start from there and your token consumption is probably going to be a lot higher than if you said, well, I'm going to have like three people or fi…”
Franceschi: AI Commoditizes Execution; Choosing What to Build Is the Bottleneck
“The execution is out, right? The execution is gone and the model is going to do that better. The wisdom to choose is still, I think the. The missing bottleneck. And to me, that all comes from which signals are not in the models.”
Franceschi: AI Token Spend Will Become Every Company's Biggest Expense
“I think the, you know, it will be the biggest expense in a company, like easily.”
Franceschi: Bolting AI Onto Legacy Workflows Fails Compared to Ground-Up Redesign
“And I think that the biggest discontinuities in a positive way that we've had were when we said, hey, let's keep this old way here, keep putting it in a corner. And like, how would we design it if we started the company today from scratch? And then just doing …”
Franceschi: CEOs Must Personally Act as Their Company's Chief AI Officer
“I think the CEO needs to be the chief AI officer. Like it's not a engineering team thing. It's not like a product team thing. It's like, you have to understand the bounds of the technology better than anyone.”
Franceschi: Every Good AI Product Is Just an Agent Loop With Tools
“Every single good AI product you've used is an agent loop with tools. That's it. Like there's no, you try to sort of over-engineer the harness and then do certain things, but at the end of the day, it's skills tools and a model. Like there's not really much el…”