Jul 31, 2023 · 20m · top-founders

How We Scaled Founderpath to Process 200 Million Rows of Financial Data Per Day

Charlie Martin · 16m spoken Nathan Latka · 46s spoken
0:00 / 0:00

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

At the SaaSOpen conference, FounderPath CTO Charlie Martin explains how his lean engineering team evolved their infrastructure from a single-server monolith to an elastic microservices platform capable of processing over 200 million financial records daily. He shares actionable lessons on diagnosing system bottlenecks, balancing vertical versus horizontal scaling, and minimizing developer friction during rapid growth.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Nathan holds 4.2% of the talking time here. How this is scored →

Nathan as informed peer 0.0 Guest teaching 0.0 Guest disagreement 0.0 Nathan pushing back 0.0
05100:0010:0020:000:54–4:54 · Nathan as informed peer 0/10 Charlie Martin Outlines FounderPath's Technical Scaling Journey Charlie Martin delivers a solo keynote presentation detailing Founderpath's technical growth from a single-server setup to managing millions of data rows. There is no host interaction during this monologue.4:57–8:24 · Nathan as informed peer 0/10 Diagnosing System Bottlenecks and Resolving SQL Indexing Issues Charlie explains initial diagnostic procedures for infrastructure bottlenecks, focusing on disk space, memory, and missing database indices in Postgres during a solo stage presentation.8:26–11:26 · Nathan as informed peer 0/10 Vertical Scaling Limitations and Peak Traffic Inefficiencies The presentation continues uninterrupted as Charlie breaks down the economic inefficiencies and single points of failure inherent in vertical scaling under spike-heavy traffic loads.11:26–13:45 · Nathan as informed peer 0/10 Transitioning to Horizontal Scaling to Handle Spikes in Demand Charlie presents the trade-offs of horizontal scaling, highlighting automated infrastructure provisioning alongside increased local developer environment complexity.13:49–17:49 · Nathan as informed peer 0/10 Implementing Microservices and Mitigating Developer Friction Charlie wraps up the core presentation by discussing the migration to microservices, building internal tooling for local testing, and summarizing architectural best practices.17:53–20:27 · Nathan as informed peer 0/10 Audience Q&A on Scaling Milestones and Database Architecture The session concludes with an audience Q&A regarding Postgres versus time series databases like TimescaleDB, maintained in a polite, collaborative conference format.0:54–4:54 · Guest teaching 0/10 Charlie Martin Outlines FounderPath's Technical Scaling Journey Charlie Martin delivers a solo keynote presentation detailing Founderpath's technical growth from a single-server setup to managing millions of data rows. There is no host interaction during this monologue.4:57–8:24 · Guest teaching 0/10 Diagnosing System Bottlenecks and Resolving SQL Indexing Issues Charlie explains initial diagnostic procedures for infrastructure bottlenecks, focusing on disk space, memory, and missing database indices in Postgres during a solo stage presentation.8:26–11:26 · Guest teaching 0/10 Vertical Scaling Limitations and Peak Traffic Inefficiencies The presentation continues uninterrupted as Charlie breaks down the economic inefficiencies and single points of failure inherent in vertical scaling under spike-heavy traffic loads.11:26–13:45 · Guest teaching 0/10 Transitioning to Horizontal Scaling to Handle Spikes in Demand Charlie presents the trade-offs of horizontal scaling, highlighting automated infrastructure provisioning alongside increased local developer environment complexity.13:49–17:49 · Guest teaching 0/10 Implementing Microservices and Mitigating Developer Friction Charlie wraps up the core presentation by discussing the migration to microservices, building internal tooling for local testing, and summarizing architectural best practices.17:53–20:27 · Guest teaching 0/10 Audience Q&A on Scaling Milestones and Database Architecture The session concludes with an audience Q&A regarding Postgres versus time series databases like TimescaleDB, maintained in a polite, collaborative conference format.0:54–4:54 · Guest disagreement 0/10 Charlie Martin Outlines FounderPath's Technical Scaling Journey Charlie Martin delivers a solo keynote presentation detailing Founderpath's technical growth from a single-server setup to managing millions of data rows. There is no host interaction during this monologue.4:57–8:24 · Guest disagreement 0/10 Diagnosing System Bottlenecks and Resolving SQL Indexing Issues Charlie explains initial diagnostic procedures for infrastructure bottlenecks, focusing on disk space, memory, and missing database indices in Postgres during a solo stage presentation.8:26–11:26 · Guest disagreement 0/10 Vertical Scaling Limitations and Peak Traffic Inefficiencies The presentation continues uninterrupted as Charlie breaks down the economic inefficiencies and single points of failure inherent in vertical scaling under spike-heavy traffic loads.11:26–13:45 · Guest disagreement 0/10 Transitioning to Horizontal Scaling to Handle Spikes in Demand Charlie presents the trade-offs of horizontal scaling, highlighting automated infrastructure provisioning alongside increased local developer environment complexity.13:49–17:49 · Guest disagreement 0/10 Implementing Microservices and Mitigating Developer Friction Charlie wraps up the core presentation by discussing the migration to microservices, building internal tooling for local testing, and summarizing architectural best practices.17:53–20:27 · Guest disagreement 0/10 Audience Q&A on Scaling Milestones and Database Architecture The session concludes with an audience Q&A regarding Postgres versus time series databases like TimescaleDB, maintained in a polite, collaborative conference format.0:54–4:54 · Nathan pushing back 0/10 Charlie Martin Outlines FounderPath's Technical Scaling Journey Charlie Martin delivers a solo keynote presentation detailing Founderpath's technical growth from a single-server setup to managing millions of data rows. There is no host interaction during this monologue.4:57–8:24 · Nathan pushing back 0/10 Diagnosing System Bottlenecks and Resolving SQL Indexing Issues Charlie explains initial diagnostic procedures for infrastructure bottlenecks, focusing on disk space, memory, and missing database indices in Postgres during a solo stage presentation.8:26–11:26 · Nathan pushing back 0/10 Vertical Scaling Limitations and Peak Traffic Inefficiencies The presentation continues uninterrupted as Charlie breaks down the economic inefficiencies and single points of failure inherent in vertical scaling under spike-heavy traffic loads.11:26–13:45 · Nathan pushing back 0/10 Transitioning to Horizontal Scaling to Handle Spikes in Demand Charlie presents the trade-offs of horizontal scaling, highlighting automated infrastructure provisioning alongside increased local developer environment complexity.13:49–17:49 · Nathan pushing back 0/10 Implementing Microservices and Mitigating Developer Friction Charlie wraps up the core presentation by discussing the migration to microservices, building internal tooling for local testing, and summarizing architectural best practices.17:53–20:27 · Nathan pushing back 0/10 Audience Q&A on Scaling Milestones and Database Architecture The session concludes with an audience Q&A regarding Postgres versus time series databases like TimescaleDB, maintained in a polite, collaborative conference format.

speaking balance: gold is Nathan, purple is the guest (3 minute bins)

0:00 · Nathan 29.1% · guest 70.9%0:00 · Nathan 29.1% · guest 70.9%3:00 · Nathan 0% · guest 100%3:00 · Nathan 0% · guest 100%6:00 · Nathan 0% · guest 100%6:00 · Nathan 0% · guest 100%9:00 · Nathan 0% · guest 100%9:00 · Nathan 0% · guest 100%12:00 · Nathan 0% · guest 100%12:00 · Nathan 0% · guest 100%15:00 · Nathan 0% · guest 100%15:00 · Nathan 0% · guest 100%18:00 · Nathan 0% · guest 100%18:00 · Nathan 0% · guest 100%
Sharpest disagreement ▶ 2:25 Premature optimization critique

In a talk devoid of direct interpersonal conflict, Charlie's firmest contrarian stance is dismissing over-engineered early-stage architectures in favor of solving immediate problems.

Hardest push from Nathan ▶ 19:36 Audience question on time series databases

An audience member gently questions whether Founderpath considers time series databases, prompting Charlie to explain their rationale for sticking with Postgres.

Biggest teaching moment ▶ 7:00 Explaining index locking on large Postgres tables

Charlie educates the audience on why adding indices must be done early before multi-million row tables lock up memory during migration.

Nathan holds their own ▶ 0:00 Nathan Latka's conference introduction

Host Nathan Latka sets high expectations for actionable metrics and operational tactics presented at SaaS Open.

the scores for every segment, with the reasoning behind each
ChapterTopicNathan as informed peerGuest teachingGuest disagreementNathan pushing backWhy
Charlie Martin Outlines FounderPath's Technical Scaling Journey 0000 Charlie Martin delivers a solo keynote presentation detailing Founderpath's technical growth from a single-server setup to managing millions of data rows. There is no host interaction during this monologue.
Diagnosing System Bottlenecks and Resolving SQL Indexing Issues 0000 Charlie explains initial diagnostic procedures for infrastructure bottlenecks, focusing on disk space, memory, and missing database indices in Postgres during a solo stage presentation.
Vertical Scaling Limitations and Peak Traffic Inefficiencies 0000 The presentation continues uninterrupted as Charlie breaks down the economic inefficiencies and single points of failure inherent in vertical scaling under spike-heavy traffic loads.
Transitioning to Horizontal Scaling to Handle Spikes in Demand 0000 Charlie presents the trade-offs of horizontal scaling, highlighting automated infrastructure provisioning alongside increased local developer environment complexity.
Implementing Microservices and Mitigating Developer Friction 0000 Charlie wraps up the core presentation by discussing the migration to microservices, building internal tooling for local testing, and summarizing architectural best practices.
Audience Q&A on Scaling Milestones and Database Architecture 0000 The session concludes with an audience Q&A regarding Postgres versus time series databases like TimescaleDB, maintained in a polite, collaborative conference format.

Statements from this episode (8)

Assertion Not checkable as stated
Martin: FounderPath Had $1M ARR and Two Engineers in 2021
“This is how it started, twenty-twenty-one. One server, one database, one engineer for half that year, two for the second half. We had, like, 1500 users, one million ARR, and we had absolutely no problems, right? Like, we just had one cloud server and one datab…”
Charlie Martin Jul 31, 2023 ▶ 3:42
Insight
Martin: Add database indices early before tables exceed memory capacity
“I recommend doing this early and often because it gets harder and harder to add missing indices, the bigger tables get. As you start getting into the tens of millions, adding, you know, you basically have to be able to load the table into memory to add the ind…”
Charlie Martin Jul 31, 2023 ▶ 7:38
Assertion Not checkable as stated
Martin: Founderpath Reached $19M ARR With Three Engineers in 2022
“So, anyway, twenty-twenty-two comes along, and we vertically scaled, right? We added a second server, but we didn't necessarily have to but we upsized Both of our servers and our database big time. We have three engineers at this point. We have about 5000 user…”
Charlie Martin Jul 31, 2023 ▶ 9:28
Disclosure
Founderpath reached $75M ARR and 20,000 users with seven engineers in 2023
“So, in twenty-twenty-three, by this time we have three databases because as you'll see shortly, we, we've also split into microservices. Seven engineers, about 20,000 users, something like seventy-five million ARR”
Charlie Martin Jul 31, 2023 ▶ 11:35
Insight
Martin: Microservices and horizontal scaling severely complicate developer environment setup
“So the developer experience got way more complicated, right? So like, you know, we have just like a TypeScript engineer who does front end, and suddenly just to set up his development environment you know, he's gotta understand how Kubernetes works, or, you kn…”
Charlie Martin Jul 31, 2023 ▶ 12:52
Insight
Martin: Startups should scale vertically before moving to horizontal architecture
“Scale vertically for as long as you can, because it's way simpler. And scale horizontally when you absolutely need to.”
Charlie Martin Jul 31, 2023 ▶ 16:26
Assertion Not checkable as stated
Martin: Founderpath processes 200M rows daily with four full-time engineers
“Three of those guys are actually contractors, so we have four full-time engineers, and we ingest about twenty million new rows of data per day, and every single day we have to rerun all the calculations on all of the data, so it's like, it's at like two hundre…”
Charlie Martin Jul 31, 2023 ▶ 17:17
Assertion Not checkable as stated
FounderPath saw 80x demand spikes in an hour after media appearances
“Every time we would, you know, we'd have, like, Nathan would be on TV, or, like, he would get, like, a TechCrunch article, and all of a sudden we would have, like, 80 times the demand for one hour that we had before”
Charlie Martin Jul 31, 2023 ▶ 18:26
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 2,600 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.