The Ledger

Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.

clear all ✕

why aren't all 3 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable

Disclosure
Three-worker Mechanical Turk consensus often failed expert data accuracy checks
“We originally hired Amazon Mechanical Turks, and we said, hey, we'll save money. We'll have three of them review every response. But we'd often see that even if all three of them gave the same output, we would go to an expert researcher or a customer or look a…”
Ryan Glasgow Sep 7, 2023 ▶ 16:21 A guide to building product in a post-LLM world | Ryan Glasgow and Kevin Mandich from Sprig
Disclosure
Pitching a product as an automated researcher alienated early customers
“I remember at first the very early days of Sprig, there was some wording around your automated user researcher, you know, or it does all the text analysis for you. And that was actually very off putting for both user researchers and product teams.”
Ryan Glasgow Sep 7, 2023 ▶ 47:27 A guide to building product in a post-LLM world | Ryan Glasgow and Kevin Mandich from Sprig
Disclosure
Sprig hired a Yale faculty member specifically to review model outputs
“We brought on a world-class researcher who was actually on the faculty at Yale as one of our other You know, very early team members. She was actually the fourth person to join SPRIG, and her first role was reviewing.”
Ryan Glasgow Sep 7, 2023 ▶ 16:56 A guide to building product in a post-LLM world | Ryan Glasgow and Kevin Mandich from Sprig
Made with StarZero

Turn any episode into a week of clips.

This entire site, about 80 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.