Baxter: Notes drop likes and reposts by 30% to 40% in internal A/B tests
Jay Baxter · An inside look at X’s Community Notes | Keith Coleman & Jay Baxter · Feb 27, 2025 · at 27:18
Jay Baxter, founding ML engineer for Community Notes at X, shares internal experimental metrics on how user engagement changes when Community Notes are displayed.
0:00 / 0:12exact quote · 12.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We saw more like 30 to 40% engagement rate drops for likes and reposts and an AB test we ran. When comparing showing a post with or without a note”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Jay Baxter
Baxter: Bridging agreement between polarized users ensures accuracy and neutrality
“I think the key thing really that we do is we actually look for agreement from people who have disagreed in the past. And what we see is when people actually have that sort of surprising agreement, that's what makes the notes so neutral and accurate and well w…”
Baxter: Bridging algorithms enable crowdsourced moderation without external fact-checker labels
“If you said I think like back in 2020, before we started building anything here, whether this could work at all, I think a room of ML engineers would say, oh, you have to keep it closed source. You know, people are going to be manipulating this all the time. Y…”
Baxter: Research shows crowdsourced lay fact-checkers match professional fact-checkers
“There was, you know, original research you know, before, before birdwatch even started or community notes even started from external researchers showing that, you know, crowdsource fact checkers can do, you know, lay people can do about as well as Fact checker…”
Baxter: Independent studies show Community Notes change user belief in claims
“Actually, there have been external studies, you know, run by people totally independent of us who have found that if you take a community note or a post with or without a community note, that actually people's agreement with the core claims in the post does ch…”