Klein: Teams in a garden path study failed to surface collective doubts
Gary Klein · Gary Klein with Paul Sonkin and Paul Johnson – Conducting Pre-Mortem Analysis (Capital Allocators, EP.109) · Sep 23, 2019 · at 36:51
Cognitive psychologist Gary Klein explains why team members remain silent about anomalies during decision-making exercises.
0:00 / 0:50exact quote · 50.1s
720p mp4 · rendered on demand · StarZero watermark
“And we once did a study where we had four-person teams going through an exercise, and it's called a garden path exercise, where we introduced something at the beginning that made it seem that certain thing was going to happen, and everybody was preparing for it, but that was wrong. We were trying to mislead them, and then we dribbled in cues to indicate that it was something else going on, and we wanted to see when the team would get off the garden path. We ran seven teams None of them got off the garden path. The initial assumption held for the entire session, so that was a failure, but we had each person keep a diary of what they were thinking, and we found that in every team, at least one or two people had noticed the anomalies and had worried about it, so the knowledge was in the team.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Gary Klein
Klein: Experts rely on situational recognition, not comparing options
“And the discovery we made is that people don't Generate lots of options and use lots of standard evaluation dimensions. They use their experience to size up situations very quickly and to identify what's going on, what's likely to happen next, what can I accom…”
Klein: Pre-mortem leaders must share a serious risk first to set candor
“And the reason for that is people don't know how candid to be, and the leader is going to set an example. And if the leader picks something that's frivolous or trivial, that tells people not to take it seriously. So it's really important for the leader to come…”
Klein: Research shows using a devil's advocate produces significantly worse outcomes
“I'm only aware of one study that tried to evaluate the effect of a devil's advocate to see if it had an effect, and they got a significant result. It was significantly worse than not using a devil's advocate.”
Klein: Pre-mortems reduce overconfidence significantly more than listing pros and cons
“Listing pros and cons are just cons. Reduced confidence, but the premortem reduced confidence more than any of the other techniques we measured.”
Klein: True expertise relies on tacit knowledge, not explicit rules
“For complex tasks and ambiguous situations with lots of uncertainty, there's no set of rules that are sufficient, and an expertise is It's not about just incorporating all the rules. Expertise is about building tacit knowledge, and that's the core.”