Feb 20, 2016 · 53m · knowledge-project
#8 Julia Galef: The Art of Changing Minds
0:00 / 0:00
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this episode of The Knowledge Project, host Shane Parrish interviews Julia Galef, co-founder of the Center for Applied Rationality, to examine how individuals can overcome cognitive biases, integrate intuition with deliberate reasoning, and cultivate practical habits for truth-seeking and ethical persuasion.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Shane holds 15% of the talking time here. How this is scored →
Shane as informed peer 2.3 Guest teaching 2.6 Guest disagreement 0.8 Shane pushing back 0.9
speaking balance: gold is Shane, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 40:08 Rejecting the diehard rationalist assumption
Julia explicitly rejects Shane's suggestion that she expects people to adopt good arguments, calling that expectation irrational and defining it as the essence of Straw Vulcanism.
Hardest push from Shane ▶ 31:44 Information cost pushback against deliberate processingShane challenges Julia's trigger-action framework by pointing out that in an information-rich world, deliberate slow processing creates impractical cognitive costs.
Biggest teaching moment ▶ 40:16 The Straw Vulcan trap of expecting human rationalityJulia educates Shane on why expecting other people to behave rationally is Spock's fundamental error, explaining that ignoring human irrationality is itself deeply irrational.
Shane holds their own ▶ 31:44 Shane cites the cognitive processing trade-off in modern media consumptionShane articulates a sharp systemic critique regarding the economic and temporal constraints on applying deliberate System 2 reasoning to massive flows of daily information.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Shane as informed peer | Guest teaching | Guest disagreement | Shane pushing back | Why |
|---|---|---|---|---|---|---|
| Childhood Roots of Curiosity and Skepticism | 1 | 1 | 0 | 0 | Shane asks open-ended biographical questions regarding the origins of Julia's interest in rationality. Julia shares childhood stories about her parents' openness and intellectual curiosity in a friendly, conversational exchange. | |
| The Founding Mission of the Center for Applied Rationality | 1 | 2 | 0 | 0 | Shane invites Julia to explain the mission of the Center for Applied Rationality (CFAR). Julia gives an informative overview of the gap between academic cognitive bias research and real-world applied interventions. | |
| Defining Epistemic and Instrumental Rationality | 3 | 3 | 0 | 1 | Julia outlines the philosophical distinction between epistemic and instrumental rationality. Shane actively engages by offering a practical heuristic of eliminating obvious stupidity to make better choices. | |
| Deconstructing the Straw Vulcan: System 1 Intuition vs. System 2 Reasoning | 2 | 3 | 1 | 0 | Julia deconstructs the pop-culture trope that rationality means suppressing emotions and intuition, explaining the evolutionary roles of System 1 and System 2 cognitive processes. | |
| Reconciling Art, Pleasure, and Rational Living | 3 | 3 | 1 | 2 | Shane presses Julia on whether appreciating art and emotional experiences can be considered rational. Julia explains that fulfilling emotional and aesthetic needs is essential to instrumental goal achievement. | |
| Cultivating the Internal Motivation to Change One's Mind | 3 | 4 | 2 | 2 | Shane asks how to open up closed-minded individuals, and Julia gently reframes the premise, arguing that everyone has blind spots and that foundational motivation to update beliefs must come internally. | |
| Actionable Habits and Trigger-Action Plans for Open-Mindedness | 4 | 3 | 1 | 3 | Shane challenges the practicality of trigger-action plans by highlighting the overwhelming cognitive cost of deliberate slow thinking in an information-heavy age, prompting Julia to clarify how conscious habits become automated over time. | |
| Mind-Body Awareness and Emotional Clues in Reasoning | 2 | 2 | 0 | 0 | Julia explores somatic and emotional clues that signal defensive thinking, sharing insights from CFAR's integration of martial arts and mindfulness practices. | |
| Ethical Persuasion vs. Subconscious Influence Techniques | 3 | 5 | 3 | 2 | When Shane asks if Julia expects people to adopt good arguments purely on logic, Julia firmly rejects the framing, explaining that expecting humans to act purely logically is itself an irrational 'Straw Vulcan' error. | |
| Combating Manufactured Doubt and Cherry-Picked Data | 3 | 2 | 1 | 1 | Shane asks how institutions can combat manufactured doubt and cherry-picked scientific studies. Julia candidly admits the difficulty and concedes that ethical persuasion might require non-epistemic tactics like ad buys and repetition. | |
| Foundational Reading: Ayer, Tetlock, and Effective Altruism | 2 | 3 | 0 | 0 | Julia recommends formative philosophical texts and works on forecasting and effective altruism, while Shane engages on logical positivism and the limits of unfalsifiable philosophy. | |
| Episode Conclusion and Farnam Street Resources | 0 | 0 | 0 | 0 | Solo host outro providing links to show notes, newsletters, and transcripts. |
Statements from this episode (20)
Galef: Attempting to Solve a Problem First Makes the Solution Stick Better
“You know how when you try to solve a puzzle and someone tells you the answer, it's much more satisfying and it sticks with you more than if they just tell you the puzzle and then tell you the answer straight away.”
Galef: Overcoming Cognitive Biases Requires Practice on Real-Life Problems, Not Labs
“I would expect that to change ingrained habits of thought and behavior, you need more longer term practice on real life issues, not on toy problems, you know, in a lab.”
Galef: Practical decision-making requires ruling out bad choices rather than seeking perfection
“In practice, it's not helpful to think about there being one very best choice that you can know for certain, but you can, you know, With some careful reasoning and using some good heuristics or rules of thumb, you can sort of rule out some obviously bad choice…”
Galef: Rationality Involves Integrating Intuition Rather Than Suppressing It
“Rationality is, it's less about ignoring or suppressing system one intuition, and more about understanding the sort of respective strengths and weaknesses of the two systems, and learning how to sort of get them to communicate with each other so to speak get y…”
Galef: Art creation is orthogonal to rationality because it is expressive
“I kind of think of art as being orthogonal independent of rationality. The kinds of things that the artist is trying to do are mostly not trying to get the right answer to a question or achieve a goal. It's more of an expressive process.”
Galef: Appreciating art satisfies human goals often overlooked in rationality
“But in terms of appreciating art I'd say for many people, maybe for most people, for some form of art, that's very important for their goals. And the kinds of goals I'm thinking of Are indeed the kinds of goals that people usually don't think of when I say the…”
Galef: Changing your mind requires gut-level acceptance of your own blind spots
“To change your own mind, I mean, the first step I would say is just believing that that's a desirable thing to do, which many or most people don't really either would explicitly say is a bad thing to do, because changing your mind makes you kind of wishy-washy…”
Galef: CFAR rejects workshop applicants who want to fix others' irrationality
“And so one of the questions we ask them in the admissions interview is why are you interested in coming? What are you hoping to get out of it? And sometimes, occasionally, we get someone who says, well, I want to, like, learn how to explain rationality to the …”
Galef: Abstract advice fails to change moment-to-moment behavior
“Having this abstract commandment, eat healthy, in the back of their mind usually doesn't translate into changing their actions on a moment to moment basis.”
Galef: CFAR translates abstract rationality advice into concrete trigger-action plans
“So a lot of what CFAR ended up doing was just taking this sort of abstract advice, like be open-minded, and translating it into these sort of very concrete almost algorithms that have, that start with a cue, with a trigger.”
Galef: Test your bias by imagining a friend making the opposing argument
“When someone I dislike says something, I now sort of automatically, well, actually not all the time, but it, I sort of have an intuitive sense for when this would be a useful thing to do. I will automatically imagine that someone I like said the exact same thi…”
Galef: Emotional reactions serve as clues to identifying cognitive blind spots
“If you become more attuned to the, to your emotional reactions they can just be important clues as to where you're, what are the blind spots you're creating for yourself, and where are they?”
Galef: Changing minds with facts is harder than using psychological cues
“Changing people's minds with facts is harder than changing their minds with a smile or a gift or a nice haircut.”
Galef: Expecting other people to behave rationally is itself fundamentally irrational
“He is supposed to be the logical, rational one, but he keeps making miscalculations because he expects other people to behave rationally, and they don't. And he should know this, because he's lived among humans for ages, and the fact that he still expects peop…”
Galef: Constrains persuasion attempts strictly to facts and evidence
“I personally feel kind of morally uncomfortable with changing people's minds without facts and evidence. So it's kind of a constraint on my ability to change people's minds that I have to work, that I force myself to work within. Essentially. And that doesn't …”
Galef: Anyone can cherry-pick scientific studies to make a compelling case
“I think it's quite easy to present what looks like a very compelling case for whatever you want to convince people of. Using, using studies using quotes from experts, using even, even randomized controlled studies, which are sort of the gold standard allegedly…”
Galef: Purely rational arguments are likely insufficient to combat manufactured doubt
“Yeah, no, I really, I think it's really hard. And I think I'm not confident that there is a good way to do it while, while adhering, you know, perfectly to the standards of, you know, just using the best arguments and evidence. I think you probably have to als…”
Galef: Beliefs must yield concrete predictions to be disproven by evidence
“I think I'm more likely now to do things like, if I believe something, like let's say I believe so and so is unfair or biased, or let's say I believe rationality works, or whatever belief I have, I'm more likely to ask myself, to make myself cash out that beli…”
Galef: Tetlock's forecasters beat geopolitical and economic experts by a huge margin
“Basically, Phil Tetlock's team of forecasters outperformed by a huge margin, all the other teams of forecasters and like experts in, in politics and economics who are trying to make predictions about world events. And that's because Phil Tetlock's team was usi…”
Galef: Top charities can save 100 times more lives per dollar donated
“They're literally, like, orders of magnitude difference in the effectiveness of different charities trying to do the same thing. So just by kind of stepping back from your automatic emotional reactions and asking yourself, okay, what does the evidence show? Yo…”