The Ledger

Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.

clear all ✕

why aren't all 17 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable

Assertion Supported
McCloy: ChatGPT Does Not Index or Retrieve llms.txt by Default
“I knew that there's debate about this, but I'd say the evidence is like ChatTriPT is not indexing and it's not retrieving content from LMS.txt by default.”
Robert McCloy Jul 23, 2025 ▶ 38:52 AI is Eating Search
Assertion Supported
Robicheaux: 2B PaliGemma 2 Beats ChatGPT on MMVP with 47.3%
“The big result, and one of the reasons that I was really excited about this paper, is that they blow everything else away on MMVP. I mean, 47.3, sure, that's nowhere near human accuracy, which again is 94%, but for, you know, two billion language, two billion …”
Peter Robicheaux Dec 22, 2024 ▶ 34:28 Best of 2024 in Vision [LS Live @ NeurIPS]
Assertion Supported
Carlini: ChatGPT emitted verbatim 50+ word sequences from internet training data
“And what I can say is that the output of the model was a verbatim, at least 50 word in a row match. To some other document that appeared on the internet previously.”
Nicholas Carlini Aug 28, 2024 ▶ 1:03:03 Personal benchmarks vs HumanEval - with Nicholas Carlini of DeepMind
Assertion Supported
Prompting ChatGPT to repeat a word indefinitely leaks verbatim training data
“One of my co-authors, Milad was working on some other random experiments, and he figured out that if you prompt ChatGPT to repeat a word forever, then it will repeat the word many, many, many times in a row, and then like explode and like just start doing rand…”
Nicholas Carlini Aug 28, 2024 ▶ 1:02:16 Personal benchmarks vs HumanEval - with Nicholas Carlini of DeepMind
Assertion Supported
Houssier: Grammarly captures cross-app context that ChatGPT cannot access
“Grammarly knows, basically, where you, I say, you're switching from Google Doc to Salesforce. To LinkedIn, and now you're writing an email. So we have this augmented context even more, so like much more precise compared to something like ChatGPT, for example. …”
Loïc Houssier Dec 11, 2025 ▶ 47:50 The Future of Email: Superhuman CTO on Your Inbox As the Real AI Agent (Not ChatGPT) — Loïc Houssier
Assertion Supported
Sands: Over 1M Shopify merchants and Salesforce joining ChatGPT checkout
“There's over one million Shopify merchants coming soon, including some really big ones like Glossier and Viore. this week, Salesforce announced that they're also in”
Emily Glassberg Sands Oct 30, 2025 ▶ 26:46 The Agents Economy Backbone - with Emily Glassberg Sands, Head of Data & AI at Stripe
Assertion Supported
Sands: Walmart and Sam's Club signed up for ChatGPT Agentic Commerce Protocol
“In the last couple of days, Walmart and Sands Club have just signed up to also make their inventory purchasable Through ChatGPT and the Agentic Commerce Protocol, which, like, I don't think that there is a bigger signal on a big retailer being up for it than W…”
Emily Glassberg Sands Oct 30, 2025 ▶ 27:09 The Agents Economy Backbone - with Emily Glassberg Sands, Head of Data & AI at Stripe
Assertion Supported
Apple Siri routes requests based on the user's ChatGPT subscription tier
“If you sign into your ChatGPT account the Siri integration will actually use your subscription status to decide what type of model to use when it passes things over to ChatGPT. And so if you're you know just a free user you get, you know, the free model. But i…”
Sherwin Wu Oct 7, 2025 ▶ 29:56 DevDay 2025: Apps SDK, Agent Kit, MCP, Codex and why Prompting is More Important than Ever
Assertion Supported
Marimo AI Completions Access In-Memory Variables and Database Connections
“What's unique about doing it in Marimo is the fact that not only does Marimo see your code, but it sees all the variables in memory and it can also see your database connections, et cetera. So it can really provide rich Rich completions.”
Akshay Agrawal Jul 18, 2025 ▶ 17:56 ⚡️The Future of Notebooks - with Akshay Agrawal of Marimo
Prediction Held up
Packer: ChatGPT will likely use sleep-time compute to learn offline
“Like if you activate sleep time compute on a chatbot like ChatGPT, it can like learn about you as you're not on ChatGPT.com. I think that's, you know, kind of what they're probably going to try to do. That's the direction they're going in.”
Charles Packer Apr 21, 2025 ▶ 10:35 Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)
Assertion Supported
Weil: ChatGPT supports over 200 million weekly active users
“As we, you know, we support over two hundred million people every week on ChatGPT.”
Kevin Weil Oct 4, 2024 ▶ 1:51:49 Building AGI in Real Time (OpenAI Dev Day 2024)
Assertion Supported
Scialom: Meta had to reinvent scaling RLHF without published frontier research
“You have just the basics, but then when it comes to, like, ChatGPT or GPT Instruct or Cloud, No one published the details there. And so we had to reinvent the wheel there in a very short amount of time.”
Thomas Scialom Jul 23, 2024 ▶ 7:53 Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI
Assertion Supported
Lambert: Anthropic, ChatGPT, and Bard Use Post-Generation Moderation Classifiers
“Anthropic and ChatGPT and Bard almost surely have a classifier after, which is like, is this text good? Is this text bad?”
Nathan Lambert Jan 11, 2024 ▶ 45:13 The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert
Assertion Supported
Kant: Zhipu AI began developing models years before ChatGPT
“They started years before ChatGPT.”
Eiso Kant Jul 22, 2026 ▶ 32:39 The AI Frontier: from open weights to open research — Eiso Kant, Poolside AI
Assertion Supported
McCloy: ChatGPT personalization and custom preferences directly alter AI search retrieval and sources
“ChatGPT personalization, memories, just explicit preferences, if you set them up, do definitely affect the results you get. Now, Again, obviously, there's, they're still using traditional search, so the search index itself is not necessarily personalized, but …”
Robert McCloy Jul 23, 2025 ▶ 29:06 AI is Eating Search
Assertion Supported
Hugging Face finds LLM proxy words jumped in Common Crawl after ChatGPT
“For example, here we measured like these words ratio in different dumps of common crawl, and we can see that like the ratio really increased after chat GPT's release.”
Loubna Ben Allal Dec 24, 2024 ▶ 3:50 Best of 2024: Synthetic Data / Smol Models, Loubna Ben Allal, HuggingFace [LS Live! @ NeurIPS 2024]
Assertion Supported
Swyx: ChatGPT rewrote its frontend from Next.js to Remix
“Recently ChatGPT just rewrote from Next.js to Remix.”
Shawn Wang Nov 11, 2024 ▶ 52:47 Agents @ Work: Dust.tt — with Stanislas Polu
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.