Mar 11, 2024 · 41m · product-market-fit
For 5 years he struggled to get traction. Then with AI he grew 12x— in 1 year | Scott Stevenson, ... · PMF Show
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this episode of The Product Market Fit Show, Spellbook co-founder and CEO Scott Stevenson shares how his team navigated five years of failed experiments and lean iteration before leveraging generative AI to build a frictionless Microsoft Word integration that scaled 12x in a single year.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Pablo holds 27.1% of the talking time here. How this is scored →
Pablo as informed peer 4.5 Guest teaching 3.5 Guest disagreement 1.4 Pablo pushing back 1.2
speaking balance: gold is Pablo, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 22:15 Rejecting the lazy stereotype about lawyers hating tech
Scott pushes back forcefully against the industry cliché that lawyers are just bad at adopting technology, arguing that past software solutions were simply flawed and inflexible.
Hardest push from Pablo ▶ 32:32 Host pushes on idea generation vs filteringPablo presses Scott to clarify whether his characteristic matrix is used strictly as a testing filter or if it can actually generate initial product ideas.
Biggest teaching moment ▶ 28:22 Exposing the danger of plausible verbal narrativesScott educates on how contagious, logical-sounding verbal stories mislead boards and founders into building dead-end products instead of multidimensional pattern matching.
Pablo holds their own ▶ 17:43 Pablo breaks down pre vs post-PMF communication taxPablo articulates an authoritative breakdown of why scaling head count pre-PMF destroys agility through exponential communication overhead and direction whiplash.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Pablo as informed peer | Guest teaching | Guest disagreement | Pablo pushing back | Why |
|---|---|---|---|---|---|---|
| The Origin of Rally Legal and Mission to Reduce Friction | 4 | 2 | 1 | 1 | Pablo sets context on the journey to product-market fit and prompts Scott on Rally Legal's origin story. Scott provides a detailed narrative about personal pain points with early startup legal fees and exploring smart contracts. | |
| Early Product Iterations: Template Libraries to Law Firm Software | 4 | 3 | 1 | 1 | Scott explains the initial shift from founder templates to law firm document software after early customer feedback. Pablo probes into whether they ran proper discovery motions or just hyper-focused on one customer. | |
| Navigating the Valley of Despair and Measuring True Adoption | 5 | 4 | 2 | 2 | Pablo questions why early traction doesn't easily scale to a thousand customers. Scott breaks down the reality of superficial buy-in vs. real workflow habit change and explains using CAC payback under 12 months as a PMF metric. | |
| Testing the 'Menu of Services' Storefront Experiment | 4 | 3 | 1 | 1 | Scott details their rapid landing page and ad experiments, specifically the 'menu of services' storefront experiment that initially drove cheap demo signups but ultimately failed retention. | |
| Diagnosing the 'Wiggles of Death' in User Retention | 5 | 4 | 1 | 1 | Pablo asks how quickly one can detect failing retention. Scott introduces the 'wiggles of death' concept to illustrate brief novelty spikes that quickly collapse into zero engagement. | |
| The Discipline of Remaining Lean and Resisting Premature Scaling | 6 | 3 | 2 | 2 | Scott describes resisting pressure from the board and the industry blitzscaling hype to maintain a lean team. Pablo contributes strongly from his own founder/investor experience on pre-PMF vs post-PMF communication overhead. | |
| The AI Breakthrough: Building Spellbook and Experiencing True Pull | 4 | 4 | 1 | 1 | Scott describes the breakthrough realization from GitHub Copilot that bespoke legal drafting required AI autocomplete inside Word, leading to immediate visceral reactions and explosive KPI improvements. | |
| Product Design Principles for Frictionless Legal Software | 4 | 4 | 2 | 1 | Scott articulates why building a web app for lawyers is fatal and why Word add-ins with zero time-to-value and five-second GIF explanations were vital design constraints. | |
| The Pattern Matching Framework for Feature Ranking | 6 | 5 | 2 | 2 | Scott lays out his framework of pattern matching against 16 empirical characteristics instead of trusting verbal storytelling logic. Pablo adds insightful commentary on how founders intoxicate themselves with persuasive storytelling. | |
| Rebranding to Spellbook and Board Alignment | 4 | 3 | 1 | 1 | Scott explains the decision to spin out Spellbook under a separate brand rather than cluttering Rally with feature cruft, and describes bringing exponential traction data to a startled board. | |
| Scaling 12x in One Year and Founder Reflections | 3 | 3 | 1 | 0 | Pablo wraps up the conversation by asking for Scott's key reflection for early founders, and Scott reiterates the imperative to stay lean and avoid bolting every experiment onto a single product foundation. |
Statements from this episode (21)
Stevenson: Automating legal doc creation fails; founders need human advisors
“What we realized is even if you could automate the creation of these documents for people, they still had no idea what they say. They still need someone to trust. They still need someone to explain it to them”
Stevenson: Enterprise law firm sales cycles obscure product-market fit signals
“And I think, especially if you're working with a large customers, large law firms, you know, the danger there is like the implementation cycle can be like a year. It can be like two years to technically get something rolled out, you know, past all the committe…”
Stevenson: Rally required sub-12-month CAC payback to claim PMF
“The other way we measure PMF was CAC payback period. So we were just kind of a little bit religious about like, what's our CAC payback period, you doing this motion. And if the CAC payback period Wasn't clearly well under 12 months. We're like, okay, we don't …”
Rally tested over 100 landing pages and features to find PMF
“We roll Over a hundred landing pages with different value props, different, often there's a new feature, a little feature we built, you know, to angle the product in a certain way.”
Stevenson: Storefront pitch reduced Rally's demo acquisition costs by 90%
“What is the cost to get someone to, into a demo? Or we're like, wow, this is like, 90% lower than anything we've run before.”
Stevenson: Legal storefronts failed because lawyers cannot drive web traffic
“Lawyers could get this thing up and running, but they had no idea how to drive traffic to it. You know, they're kind of chasing this mirage of, and I'm sure Shopify has this issue too. They probably have tons of people setting up stores and no traffic going to…”
Stevenson: Storefront motion had sub-6-month CAC payback but failed retention
“And that concern passed the CAC payback test. I think our CAC payback was probably like six months on that whole motion or less, but it didn't pass the retention and kind of the usage test.”
Stevenson: The default outcome for new software feature launches is zero retention
“At our company, we say like, actually most things you launch, that's the pattern you see weeks, the wiggles of death. It's like, oh, the user's like, oh, it's a new feature. I'll play with it. And you see like a couple of little spikes of people using it and t…”
Stevenson: True PMF causes a physiological reaction and dilated pupils in customers
“We had very high conviction that like product market fit should feel having an almost physiological response from your customers where when they see the product, their pupils are dilating, you know, There's like a neurochemical reaction happening. And I rememb…”
Stevenson: Small teams iterate faster than 50-person teams during rapid experimentation
“I think a small number of people can do a lot, sometimes more than a larger number of people. If you have, if you're doing a new experiment every two weeks, very hard to get a 50 person team aligned on that. People get burned out pretty quick, but small team c…”
Srugo: Prematurely scaling developer output and hiring VPs pre-PMF is a classic mistake
“There's two worlds in my mind. There's pre-product market fit and there's post-product market fit, right? And one of the most classic things I see is, like, from, for whatever reason, implementing things that make sense post-product market fit, but too early, …”
Stevenson: Startup breakthroughs come from weekend hacking, not board meeting roadmaps
“And that's like one pattern I had noticed in our successes is that they almost all arose from this sort of like evening and weekend hacking. They never arise from like the board meeting plan or like the quarterly plan. They always arise from like, oh, I'm goin…”
Stevenson: Rigid document templating fails because legal work is inherently bespoke
“The rigid templating approach to automating contracts just kind of sucked. And it should be too long to realize this from our customer feedback, but like every deal is unique. Manually massaging text and getting it right for your client really matters. Your cl…”
Stevenson: Spellbook's initial CAC payback was under one month
“All the KPIs were off the charts. You know, cap payback was like, you know, below one month. There was like immediate cap payback and usage was like we had never, ever seen before.”
Stevenson: Software products must be explainable in a five-second GIF
“The other thing we learned is like, you have to be able to explain what your product is in like a five second GIF. And if you can't, it's like, no one has the attention span for it anymore.”
Stevenson: Legal software fails if built as a standalone web app
“And we learned that like the form of the feature, whether it's in word or not actually matters more than almost the product itself. Cause if you're building a web app for lawyers, sorry, you already lost the game.”
Stevenson: A founder's persuasive storytelling ability can distort their own product judgment
“Founders have to be good storytellers, so there's sort of, I always call it, you know, the storytelling power is sort of this dark magic, and you have to be very careful, because it can It can screw up your own radar if you use it in the wrong way.”
Stevenson: Growing feature lists overwhelm customers and harm early products
“You get this feature cruft and your feature list growing is actually not a good thing. It actually overwhelms customers. It starts to feel like it's overlapping with other products they're using.”
Stevenson: Spellbook scaled from 100 to nearly 2,000 law firms in 18 months
“Rally, you know, we had around a hundred law firms. Now we're Close to 2000 law firms on blue around the world. Yeah. So yeah. And that's in, You know, a little over a year, you know, a year to year and a half, you know, we went to two, 2000 mall firms.”
Stevenson: Spellbook processes 1 to 2 million contracts annually
“We see two, one and two million contracts a year right now go through our system.”
Stevenson: Pre-PMF startups should launch separate brands for new experiments
“Everything doesn't have to bolt on the same product when you're in the pre PMF stage. It's a totally different game. It has nothing to do with the post PMF stage. Almost you're trying a bunch of stuff. So launch different apps, launch different brands. Don't g…”