The Ledger

Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.

51statements match

14resolved → 0open claims → 12supported → 0contradicted →

why aren't all 51 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable

Assertion Supported

Hu: Honeycomb agent framework ranks number one on full SWE-bench dataset

“And then there's another one called Honeycomb, which also scored really well, and I think is number one on the full set.”

Jesse Hu Oct 19, 2024 ▶ 31:30 [Paper Club] SWE-Bench [OpenAI Verified/Multimodal] + MLE-Bench with Jesse Hu

Assertion Supported

Hu: SWE-bench scores jumped from 3% on GPT-4 RAG to 43%

“If we just use GPT-IV plus RAG, what do we get? It's, like, a measly three percent. And then up to the most recent submissions where they get up to 43%.”

Jesse Hu Oct 19, 2024 ▶ 7:40 [Paper Club] SWE-Bench [OpenAI Verified/Multimodal] + MLE-Bench with Jesse Hu

Assertion Supported

Cosine's SWE-bench model patch outputs are publicly verifiable on GitHub

“The patches are still public. So like the, dare I say, traditional Sweebench submission, you can go to a GitHub repo and see it and run them for yourself and verify that the numbers come out correctly.”

Alistair Pullen Aug 22, 2024 ▶ 50:54 Is finetuning GPT4o worth it?

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

The Ledger

Turn any episode into a week of clips.