Dec 12, 2023 · 16m · top-founders

How PandaDoc Uses CI to Manage 800 Product Updates Per Month on Path To $100m+ ARR

Serge Barysiuk · 14m spoken Nathan Latka · 28s spoken

0:00 / 0:00

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

PandaDoc CTO Sergey Barysiuk outlines how the company deploys 800 updates per month by combining automated CI/CD pipelines, staged feature flag rollouts, and coordinated product marketing packaging.

Chapters · click to jump

1 statement ▾

Barysiuk: PandaDoc deploys 800 product updates per month to production open →

1 statement ▾

Barysiuk: Most development bottlenecks occur between implementation and review open →

2 statements ▾

Barysiuk: Continuous delivery yields zero learning if customers cannot use intermediate updates open →

Barysiuk: PandaDoc maintains roughly 300 feature flags at different rollout stages open →

2 statements ▾

Barysiuk: Independent feature flag rollouts at scale create a customer mess open →

Barysiuk: Feature launches fail unless sales and customer success are enabled open →

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Nathan holds 3.1% of the talking time here. How this is scored →

Nathan as informed peer 0.0 Guest teaching 0.0 Guest disagreement 0.0 Nathan pushing back 0.0

speaking balance: gold is Nathan, purple is the guest (3 minute bins)

Sharpest disagreement ▶ 0:40 Anticipating skepticism on 800 monthly updates

In a non-adversarial solo talk, Serge playfully preempts audience skepticism by noting people might call BS on deploying 800 updates a month before proving they already did 24 that day.

Hardest push from Nathan ▶ 0:04 Host automated intro

The host is absent during the actual content segments; this brief intro snippet is the only host audio in the recording.

Biggest teaching moment ▶ 4:50 Cautioning against retrofitting CI/CD to monolithic microservices

Serge shares hard-earned architectural advice, stressing that founders must implement automated pipelines early rather than trying to retrofit them across hundreds of microservices later.

Nathan holds their own ▶ 0:04 Host promotional intro

Because the entire episode core is a conference presentation without host dialogue, no host pushback or counter-expertise occurs.

the scores for every segment, with the reasoning behind each

Chapter	Topic	Nathan as informed peer	Guest teaching	Guest disagreement	Nathan pushing back	Why
	Overcoming Bottlenecks with Continuous Integration and Continuous Deployment	0	0	0	0	This segment is entirely a solo keynote presentation delivered by Serge Barysiuk on CI/CD pipelines, with zero host interaction. Because it is a monologue, all host-side metrics are set to 0 and guest combativeness is baseline.
	Iterative Product Mindset and Feature Flag Strategy	0	0	0	0	Serge continues his presentation explaining product management mindset shifts and feature flag architecture using Split.io. There is no host involvement or adversarial tension.
	Early Adopter Recruitment and Multi-Tiered Product Analytics	0	0	0	0	Serge discusses tactical approaches to sourcing early adopters from support and CABs, alongside analytics tools like Amplitude and Tableau. The segment remains a pure instructional monologue.
	Product Marketing Alignment, Launch Packaging, and Conclusion	0	0	0	0	Serge concludes his presentation by outlining how product marketing packages continuous releases into cohesive launch stories and aligns internal teams. No host participation occurs.

Statements from this episode (6)

Assertion Not checkable as stated

Barysiuk: PandaDoc deploys 800 product updates per month to production

“So, 800 product updates. You might call BS, but I checked today, like, how many did we do today? 24 so far. They're still going. And, ah, so that's all the updates we're delivering to production, which our customers can already use.”

Serge Barysiuk Dec 12, 2023 ▶ 1:06

Insight

Barysiuk: Most development bottlenecks occur between implementation and review

“Most of the problems you see, they lie between the implementation and review”

Serge Barysiuk Dec 12, 2023 ▶ 2:35

Insight

Barysiuk: Continuous delivery yields zero learning if customers cannot use intermediate updates

“When you think about the feature, you're thinking about this end stage, and you can do continuous integration, continuous delivery all day long, but if in the middle of this process your customers can't use it, you're not learning anything. If you're waiting, …”

Serge Barysiuk Dec 12, 2023 ▶ 7:11

Disclosure

Barysiuk: PandaDoc maintains roughly 300 feature flags at different rollout stages

“So the PandaDoc, we probably right now have roughly 300 feature flags, like, ah, in the different stages, some of them they're rolled out completely, some of them they're like still, maybe like one, two percent, but this is how it works.”

Serge Barysiuk Dec 12, 2023 ▶ 9:36

Insight

Barysiuk: Independent feature flag rollouts at scale create a customer mess

“When you hit scale, and when you have four teams working on the different things in the different parts of the application, launching this to the users, and 300 feature tags, what it creates a big mess, which you put on your customers.”

Serge Barysiuk Dec 12, 2023 ▶ 13:39

Insight

Barysiuk: Feature launches fail unless sales and customer success are enabled

“And so we launch this and that feature flag to 100%. It's done, but it's not. And the teams don't know about this. They can sell it. They don't know, like, how it works and all those things. So this is very important to kind of, like, close the loop and Capita…”

Serge Barysiuk Dec 12, 2023 ▶ 15:09

How PandaDoc Uses CI to Manage 800 Product Updates Per Month on Path To $100m+ ARR

How this conversation actually went

Statements from this episode (6)

Turn any episode into a week of clips.