Insight
Forsgren: DORA metrics alone are insufficient in the AI era
“If that's all you're looking at, it's not going to be sufficient anymore because AI has now changed the way we think about feedback loops.”
Assertion Supported
Forsgren: Software delivery speed and stability move in tandem, not trade-offs
“When we started measuring these, we found that they move in tandem. Now, like, with very strong significance, right, from a statistical standpoint. Now, what this means is, now we say speed and stability move together.”
Assertion Supported
Forsgren: Software delivery performance does not statistically vary by company size
“We saw no statistical significance between Small companies and large companies, the only statistical significant, statistically significant difference was with retail.”
Insight
Forsgren: AI Coding Tools Should Free Up Cognitive Space, Not Prompt Layoffs
“Anyone who's looking at that and like, dear CEOs or whoever who are like, now I can lay off half my workforce. That's not what this is about, right? It's not about taking a task and cutting your time in half because now what we've enabled is your ability to do…”
Insight
Forsgren: Developer surveys almost always prove more accurate than telemetry during conflicts
“If there is ever a disagreement between the surveys and the instrumentation, which is incredibly advanced, almost every time that I've ever heard of the surveys are correct and not the instrumentation.”
Opinion
Forsgren: Most developer productivity metrics are a lie
“I will say most productivity metrics are a lie.”
Insight
Forsgren: Non-deterministic LLM code demands active evaluation over direct acceptance
“LLMs are non-deterministic, right? Now we can't just Put in a command and get something back and accept it. We really need to evaluate it. So, you know, are we seeing hallucinations? What's the reliability? Does it meet like the style that we would typically w…”
Opinion
Forsgren: Almost no engineering teams have reached their maximum velocity limits
“Most teams can move faster, right? So And also given what we know about cognitive load, not all speed gains are necessarily good. Right. Or the upside is going to be kind of limited, right? Once you hit kind of a certain point, most people are not even near th…”
Insight
Forsgren: Increasing engineering speed without strategy just ships trash faster
“You could, we can ship trash faster every single day. We need strategy and really smart decisions to know what to ship, what to experiment with what features we want to do in what order and what rollout, right? The strategy is the core piece. And then think ab…”
Insight
Forsgren: Measure developer satisfaction rather than general happiness
“I will say I don't love a happiness survey. Because there are too many things that contribute to happiness. Happiness is a lot, right? So happiness is work. Happiness is family. Happiness is hobbies. Happiness is weekends. Happiness. There are so many things t…”
Insight
Forsgren: Two-week change approval wait for software stability is a myth
“When I first started like ITIL and ITSM, right, the old school kind of change management processes, the common knowledge was that you had to have at least a two week wait for change approvals in order to get that stability. Turns out that's not right, right? I…”
Assertion Supported
Forsgren: Elite engineering teams deploy on demand and recover under an hour
“The elite performance of deployment frequency. You can deploy on demand. Lead time for changes takes less than a day. Time to restore is less than an hour and your change fail rate is between zero and 15%.”
Insight
Forsgren: DevOps is a set of organizational capabilities, not a toolchain
“DevOps is a set of capabilities. They're technical capabilities. They're architectural capabilities. They're cultural capabilities. They are lean management practices. That predict speed and stability and then speed and stability gives you money, right?”
Insight
Forsgren: Superior tools cannot overcome poor developer experience
“When DevEx is poor, everything else just isn't gonna help, right? The best processes, the best tools, the best Whatever magic you have, right? If the DevX is bad, everything kind of takes.”
Insight
Forsgren: High-toil engineering workflows drive burnout and block innovation
“If you're getting there in ways that are high toil or high friction, then at some point a developer is going to burn out. Or if it's, you know, super high cognitive load, if it's hard to even think about what you're doing, because you're concentrating on like …”
Insight
Forsgren: DevEx relies on flow state, cognitive load, and feedback loops
“One way to talk about it is kind of three key things that Have components that are important of themselves. They also kind of reinforce each other. So flow state is one of them. Cognitive load is another, and then feedback loops are another.”
Insight
Forsgren: AI shifts developer flow from syntax to high-level orchestration
“It helps them keep in the flow in terms of, instead of details and line by line writing, they're in the flow in terms of what's my goal. What are the pieces that I need to get there? How quickly can I get there? So then I can step back and kind of evaluate eve…”
Insight
Forsgren: SPACE framework adapts effectively to AI development environments
“We're actually seeing that space applies fairly well in these new emerging contexts like AI, because we still want to look at, so space is an acronym, right? So we still want to look at satisfaction. We still want to look at performance.”
Assertion Contradicted
Forsgren: Humans max out at four hours of deep work daily
“Gloria Mark has done some really good work on attention and deep work, and Cubans can get about four hours of good deep work a day. And like, that's about it.”
Insight
Forsgren: Improve DevEx by listening to engineers before building tools
“Start with listening and not with tools and automation. So many times companies are like, well, I'm just going to build this tool or going to, I'm going to build this thing. Often you build a thing that you yourself have had a challenge with, or that like is e…”
Assertion Not checkable as stated
Forsgren: AI prototyping cuts A/B testing cycles to under a week
“Some places it used to take, you know, months to get something through production, to do A-B testing and get feedback. We can do this in a day or two, right? Definitely under a week.”
Insight
Forsgren: Better documentation and comments directly improve AI tool performance
“Turns out agents rely on good data, right? Because it's all about how they've been trained or how they've been grounded and better data gives you better outcomes, and some of that data includes documentation and comments. And the better documentation, the bett…”
Insight
Forsgren: PMs have essential DevEx skills that engineering teams often miss
“I think it's particularly, particularly relevant for PMs because if you're PMing something that involves software and building and creating software, improving DevX will only help your team. And also you have Key skills and insights and instincts that are so i…”
Insight
Forsgren: DevEx initiatives follow a J-curve before compounding benefits
“I will mention that it tends to follow something like J curve, right? So like you'll have a couple of quick wins and it'll look like a big, big win. And then you'll hit a kind of a little divot where suddenly The really obvious projects, the low hanging fruit …”