The Ledger

Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.

clear all ✕

why aren't all 17 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable

Assertion Not checkable as stated
Lambert: Chinese open AI models currently do not contain backdoors
“Like, you can't prove that the models aren't doing certain backdoors, where I'm fairly certain they definitely aren't now.”
Nathan Lambert Nov 20, 2025 ▶ 17:52 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Prediction Not checkable as stated
Lambert: AI progress will yield steady improvements rather than rapid singularity
“I think these researchers are going to grind out improvements for multiple years, but never in a way that results in this kind of accelerating well that we get drawn into.”
Nathan Lambert Nov 20, 2025 ▶ 1:21:34 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: OLMo 3 32B base model matches Qwen 2.5 32B quality
“This base model is similar in quality to the best available, which is like Quinn's 2.5, 32 B is, was still the best base model.”
Nathan Lambert Nov 20, 2025 ▶ 4:06 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: OLMo 3 7B outperforms Meta's Llama 3.1 8B in internal tests
“And I just think of this cause like Lama 3.1 AP is one of the most used models and hugging base of all time. And this should be better. We're, In our measurements, we see it as being better than Llama.”
Nathan Lambert Nov 20, 2025 ▶ 4:54 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Partly supported
Lambert: 80% of a16z's open-model portfolio startups use Alibaba's Qwen
“80% of companies building with open models are using Quinn, which is like 16 to 24% of his portfolio, which is still a lot.”
Nathan Lambert Nov 20, 2025 ▶ 17:01 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: Chinese companies with $1B+ valuations routinely pirate SaaS software
“Mediumly large, like billion dollar plus valuation companies in China will just like pirate SaaS software.”
Nathan Lambert Nov 20, 2025 ▶ 18:47 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: Best open-license AI models near the frontier in 2025 were Chinese
“The models that are from closest to the frontier in performance with good license all happened to be Chinese models throughout the year for this case.”
Nathan Lambert Nov 20, 2025 ▶ 58:29 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Prediction Not checkable as stated
Lambert: Big tech will realize 95-98% of LLM potential by 2030
“I think that how I describe it is that big tech has all collectively realized that these language models plus scaffolding is going to unlock absolutely incredible value. And I have very high probability, barring extreme geopolitical situations, that big tech E…”
Nathan Lambert Nov 20, 2025 ▶ 1:24:19 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: As AI funding grows, fewer researchers speak in public
“There's so much money in AI and it only becomes increasingly so that the amount of people that can talk about these things in public and educate and get more people involved by spreading knowledge is ever smaller.”
Nathan Lambert Nov 20, 2025 ▶ 29:52 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Supported
Lambert: OLMo 3 models are the best open models outside Qwen 3
“I would say in post training where The best models that don't start with Quinn three and we're like reasonable to say that they are comparable to Quinn three, like on some benchmarks would beat them on some benchmarks. They're way ahead.”
Nathan Lambert Nov 20, 2025 ▶ 8:59 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Supported
Lambert: Alibaba's Qwen 3 VL vision model is a superior text model
“They released these Quinn three VL, their vision models. And like on text only benchmarks, it's way better than the models they released in April. So it's like okay, like that's the new baseline. And most people don't know about it because they think it's just…”
Nathan Lambert Nov 20, 2025 ▶ 9:46 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Prediction Not checkable as stated
Lambert predicts more US labs will release open AI models
“If you look at this podcast in the coming months, I do think there's going to be, look like there's a lot more labs in the U S participating.”
Nathan Lambert Nov 20, 2025 ▶ 16:22 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Supported
Lambert: Hugging Face outcompeted AI2's AllenNLP library
“It was the main competitor to Hugging Face Transformers. And they ultimately outcompeted AI two as the thing that people use for that because they had very different model and amount of support.”
Nathan Lambert Nov 20, 2025 ▶ 32:47 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: Long-context extension is essential for reasoning AI models
“Three is long context extension, which is absolutely essential for these reasoning models because they generate so many intermediate tokens before sharing an answer with you.”
Nathan Lambert Nov 20, 2025 ▶ 40:15 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: Larger pre-trained base models are easier to improve with RL
“A better base model and a bigger base model is much easier to improve with RL.”
Nathan Lambert Nov 20, 2025 ▶ 44:29 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Supported
Lambert: Kernel differences between vLLM and Hugging Face cause RL numerical instability
“VLLM and HuggingFace use different kernels to do the actual internal computation of the model. So these kernels are the things that make things like vLLM really fast. But these things, this then results in subtle numerical differences between the completions t…”
Nathan Lambert Nov 20, 2025 ▶ 1:15:29 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Assertion Not checkable as stated
Lambert: Most AI labs probably use evolved GRPO rather than PPO
“In reality, it seems like most people are using something like an evolved version of GRPO, which is a bit simpler than PPO.”
Nathan Lambert Nov 20, 2025 ▶ 1:16:39 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.