Pereyra: Real software engineering lacks objective unit-test verifiability at scale
Gabe Pereyra · No Priors Ep. 142 | With Harvey Co-Founder and President Gabe Pereyra · Dec 5, 2025 · at 18:44
Harvey co-founder Gabe Pereyra compares the difficulty of creating reward functions for complex legal AI to evaluating real-world software engineering.
0:00 / 0:18exact quote · 18.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think you actually have the same problem in programming, where I think in the short term programming is verifiable, where you can look at unit tests, but once you get into real software engineering, like the unit, there is no unit test. It's like I deployed this and a million users used it for six months and it didn't crash.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Gabe Pereyra
Pereyra: AI models won't change senior partner or senior engineer roles anytime soon
“When we think of the best partners we've worked with, I don't think the models are doing what they do anytime soon. And I think what's interesting is I think the role of law firm partners actually doesn't change that much in the same way. I don't think the rol…”
Pereyra: Law firms will 10x in size again due to AI
“Law firms have like 10 X in size compared to before computers and the internet. And I think that's going to happen again, but in like maybe a different way than the past 20 years.”
Pereyra: Law firms are acting as Harvey implementation partners for clients
“Law firms are starting to do this for their in-house clients. So they're starting to go and take Harvey and go to their clients and say, Hey, buy Harvey and we'll help you build all the workflows and implement it because we have the scale and the expertise to …”
Pereyra: Building a tech-enabled law firm requires running two incompatible companies
“The big challenge that they ran into was, you're essentially just building two different companies, right? You're building a law firm, And you're building a tech company, and it's already really hard to, like, build product engineering, do AI, scale sales, and…”
Pereyra: 20% faster coding does not produce products 20% faster
“Making someone program 20% faster doesn't make you build a product 20% faster. And so starting to think about, like, what is the broader infrastructure you need so these companies can develop software and product faster?”
Pereyra: Enterprise AI bottlenecks are orchestration and governance, not model intelligence
“When you get to that scale, a lot of the problems we're solving are not just model intelligence problems. They are these orchestration, governance, and kind of all of the enterprise product problems that you run into at scale.”