Insight certainty 4/5 debate potential 2/5

Forsgren: Limit DevEx barrier surveys to three prioritized items for clearer signal

Nicole Forsgren · How to measure AI developer productivity in 2025 | Nicole Forsgren · Oct 19, 2025 · at 54:35

Nicole Forsgren, creator of the DORA and SPACE frameworks, explains effective survey design for measuring developer experience when system telemetry is absent.

0:00 / 0:20exact quote · 20.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“That can give you incredible signal because by making folks prioritize the top three things, if you let them pick everything, like it makes the data super, super messy, but three things and how often you can just come up with a score or a weighted score if you want, and then go kind of dig into where should that data be?”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Nicole Forsgren

Insight
Forsgren: DORA metrics alone are insufficient in the AI era
“If that's all you're looking at, it's not going to be sufficient anymore because AI has now changed the way we think about feedback loops.”
Nicole Forsgren Oct 19, 2025 ▶ 14:08 How to measure AI developer productivity in 2025 | Nicole Forsgren
Assertion Supported
Forsgren: Software delivery speed and stability move in tandem, not trade-offs
“When we started measuring these, we found that they move in tandem. Now, like, with very strong significance, right, from a statistical standpoint. Now, what this means is, now we say speed and stability move together.”
Nicole Forsgren Jul 30, 2023 ▶ 15:01 How to measure and improve developer productivity | Nicole Forsgren (Microsoft Research, Github)
Assertion Supported
Forsgren: Software delivery performance does not statistically vary by company size
“We saw no statistical significance between Small companies and large companies, the only statistical significant, statistically significant difference was with retail.”
Nicole Forsgren Jul 30, 2023 ▶ 22:55 How to measure and improve developer productivity | Nicole Forsgren (Microsoft Research, Github)
Insight
Forsgren: AI Coding Tools Should Free Up Cognitive Space, Not Prompt Layoffs
“Anyone who's looking at that and like, dear CEOs or whoever who are like, now I can lay off half my workforce. That's not what this is about, right? It's not about taking a task and cutting your time in half because now what we've enabled is your ability to do…”
Nicole Forsgren Jul 30, 2023 ▶ 52:35 How to measure and improve developer productivity | Nicole Forsgren (Microsoft Research, Github)
Insight
Forsgren: Developer surveys almost always prove more accurate than telemetry during conflicts
“If there is ever a disagreement between the surveys and the instrumentation, which is incredibly advanced, almost every time that I've ever heard of the surveys are correct and not the instrumentation.”
Nicole Forsgren Jul 30, 2023 ▶ 55:55 How to measure and improve developer productivity | Nicole Forsgren (Microsoft Research, Github)
Opinion
Forsgren: Most developer productivity metrics are a lie
“I will say most productivity metrics are a lie.”
Nicole Forsgren Oct 19, 2025 ▶ 12:24 How to measure AI developer productivity in 2025 | Nicole Forsgren
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.