Martin: Microservices and horizontal scaling severely complicate developer environment setup
Charlie Martin · How We Scaled Founderpath to Process 200 Million Rows of Financial Data Per Day · Jul 31, 2023 · at 12:52
Founderpath CTO Charlie Martin explains the negative developer productivity trade-offs encountered when moving from a monolith to horizontal microservices.
0:00 / 0:36exact quote · 36.8s
720p mp4 · rendered on demand · StarZero watermark
“So the developer experience got way more complicated, right? So like, you know, we have just like a TypeScript engineer who does front end, and suddenly just to set up his development environment you know, he's gotta understand how Kubernetes works, or, you know, he's gotta like, If he wants to run one service in production and the other service in development, or one in staging and the other in development, like, he spends hours just getting set up just so he can do the thing that we want to pay him to do, which is write some TypeScript, right? So, complexity ramps up. You basically need an ops guy”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Charlie Martin
Martin: Add database indices early before tables exceed memory capacity
“I recommend doing this early and often because it gets harder and harder to add missing indices, the bigger tables get. As you start getting into the tens of millions, adding, you know, you basically have to be able to load the table into memory to add the ind…”
Martin: Startups should scale vertically before moving to horizontal architecture
“Scale vertically for as long as you can, because it's way simpler. And scale horizontally when you absolutely need to.”
Martin: FounderPath Had $1M ARR and Two Engineers in 2021
“This is how it started, twenty-twenty-one. One server, one database, one engineer for half that year, two for the second half. We had, like, 1500 users, one million ARR, and we had absolutely no problems, right? Like, we just had one cloud server and one datab…”
Martin: Founderpath Reached $19M ARR With Three Engineers in 2022
“So, anyway, twenty-twenty-two comes along, and we vertically scaled, right? We added a second server, but we didn't necessarily have to but we upsized Both of our servers and our database big time. We have three engineers at this point. We have about 5000 user…”
Founderpath reached $75M ARR and 20,000 users with seven engineers in 2023
“So, in twenty-twenty-three, by this time we have three databases because as you'll see shortly, we, we've also split into microservices. Seven engineers, about 20,000 users, something like seventy-five million ARR”
Martin: Founderpath processes 200M rows daily with four full-time engineers
“Three of those guys are actually contractors, so we have four full-time engineers, and we ingest about twenty million new rows of data per day, and every single day we have to rerun all the calculations on all of the data, so it's like, it's at like two hundre…”