Forsgren: Always define hypotheses in words before selecting metrics
Nicole Forsgren · How to measure and improve developer productivity | Nicole Forsgren (Microsoft Research, Github) · Jul 30, 2023 · at 59:18
Nicole Forsgren explains her 'four box framework' for metric design and hypothesis testing during an interview on developer productivity and measurement.
0:00 / 0:04exact quote · 4.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Now always start with words. Do not start with data. You always start with words.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Nicole Forsgren
Forsgren: DORA metrics alone are insufficient in the AI era
“If that's all you're looking at, it's not going to be sufficient anymore because AI has now changed the way we think about feedback loops.”
Forsgren: Software delivery speed and stability move in tandem, not trade-offs
“When we started measuring these, we found that they move in tandem. Now, like, with very strong significance, right, from a statistical standpoint. Now, what this means is, now we say speed and stability move together.”
Forsgren: Software delivery performance does not statistically vary by company size
“We saw no statistical significance between Small companies and large companies, the only statistical significant, statistically significant difference was with retail.”
Forsgren: AI Coding Tools Should Free Up Cognitive Space, Not Prompt Layoffs
“Anyone who's looking at that and like, dear CEOs or whoever who are like, now I can lay off half my workforce. That's not what this is about, right? It's not about taking a task and cutting your time in half because now what we've enabled is your ability to do…”