Pereyra: Vertical AI Does Not Need Trillion-Parameter Models for Narrow Tasks
Gabe Pereyra · Harvey Co-Founder Gabe Pereyra on the Token Pricing Reckoning Coming for AI · Sourcery with Molly O'Shea · Jun 18, 2026 · at 23:21
Gabe Pereyra, co-founder of Harvey, explains how domain-specific AI products can achieve frontier-level performance while avoiding the high costs of generalist models.
0:00 / 0:13exact quote · 13.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“A lot of these like very large frontier models are large because they're good at everything. And so I think a lot of the opportunity for these like specific verticals will be, okay, I probably don't need a trillion parameters if I just need the system to be good at diligence.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Gabe Pereyra
Pereyra: Client conflict rules mean law firms need multiple AI providers
“Most of these law firms and enterprises Can't rely on a single lab provider. So like there's a big risk if you're a law firm that if you just use Anthropic or you just use OpenAI you run into conflict risk. So imagine you're using only Anthropics models as a l…”
Pereyra: AI Pricing Will Likely Return to Subscription Models From Tokens
“Buying off tokens is insanely complicated. It'll probably at some point go back to something like subscription because it's hard to like forecast these things.”
Pereyra: Token billing will spawn an optimization ecosystem to counter model incentives
“I think you're going to start seeing things like this for token billing, where there's going to become this whole ecosystem of like, how do you optimize around this? Because you kind of have these weird misaligned incentives from the model providers, right? Be…”
Pereyra: Big Law work can be objectively quantified and unit-tested
“And I think there's a bit of a misconception that, oh, legal is subjective, so you can't do this. And I think the thing for especially big law is a lot of the work you can actually quantify, and this is what senior associates and partners are doing when their …”
Harvey plans to open-source general AI and monetize private enterprise infrastructure
“We think of our strategy as we want to open source the general stuff and work with all of the providers to make these models as good as possible at general legal. And then we want to build infrastructure for these law firms and enterprises that help them own t…”