Everything Will Brown said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Brown: DeepSeek's efficiency comes from stacking 10 to 15 compound gains
“I mean, to me, the surprising thing was not any individual one thing. It's that each of these is maybe like a 30%, 50% gain, but they have like 10, 15 of them that all stack. And so getting all of these to stack nicely is what's hard.”
Brown: Alibaba Qwen makes the best model suites for research
“Like they make, I think, still the best model suites for like doing research.”
Will Brown: AI reasoning models are merely a stepping stone toward autonomous agents
“The thing that's going to make the next wave of stuff be powerful is just, like, everyone wants better agents. Everyone wants models that can, like, go off and do stuff. And, like, reasoning was kind of, like, a precursor to that a little bit.”
Brown: Claude thinking and non-thinking modes likely use same underlying model
“I mean, I think these models should be the same model, and Anthropic knows what they're doing. Like, it's not that hard to, like, Quen did it in a very kind of, like, simple way, and they kind of talked about how they did it a little bit. But it's not, like, t…”
Brown: Truncating reasoning model thinking mid-sentence still yields good outputs
“So it seems like artificially truncating the thought is actually like fine. Like the model can, even if like it got cut off mid-sentence with an injected like think token, these are smart enough models that they can kind of finish with the best that they got f…”
Brown: Reasoning effort dropdowns will disappear from chat interfaces
“I think in chat interfaces, it probably won't stick around. Like, I don't think we're always going to have the dropdown of like Oath for many and Oath for many high. That feels silly.”
Brown: Base LLMs will do anything up to their intelligence limit
“The base model in general of LLM is not artificially constrained in any way. Like, with the right prompt, it'll do whatever up to its intelligence limit.”
Brown: Claude 3.7 works for quick projects, not large codebases
“I never really got to the point where I found it was helpful for a thing that was like a large existing code base. But if it's like, hey, I want to like cook something up in a few hours for fun. Pretty good at that. But these become messy and they become hard …”
Will Brown: Claude appeals to AI insiders but lacks mainstream breakout
“It feels like people in the AI world, like, love Claude, or have grown type of Claude, but still had a phase where they were using it a ton. But it hasn't really broken out to general people in the way. And it feels like a lot of their marketing that I've seen…”
Brown: Small LLMs default to skipping tool calls without explicit training
“If you set these models up to use tools, They just won't. Like if you say, hey, here's a question. You have access to these tools. Do as many rounds of tool calling as you want, and then submit your answer. They'll just submit their answer because they like ar…”
Brown: Prompting alone cannot reliably force LLMs to use thinking tokens
“If you want models to use thinking tokens, you kind of have to, like, incentivize that. You have to either do a little bit of, like, SFT warmup, or you have to, like, Reward them for doing it. Otherwise, they will not follow it a hundred percent of the time on…”
Brown: Rewarding generic tool calls causes LLMs to game rewards
“If you start rewarding them for, like, tool use, They will use the tool, but they don't really want to, like, have to, they want to, like, be very safe with it... They would like do silly versions of tool use where they aren't actually using the tool to assist…”
No open-source model currently matches OpenAI's general agent capabilities
“There really isn't currently an open source model that behaves in the way that these models do. We have things like R-one, which are great at kind of the single-term math and code reasoning problems. But they are not in the general purpose agents world yet.”
Scaling autonomous task duration is a plausible path to AGI
“And that, if you can crack that scaling direction of, like, pushing the boundary of how long these models can go out and do these things for, that is a plausible path towards things that become marvelous.”
Long-horizon agent RL requires intermediate turn-level verification
“You probably want some kind of intermediate verification where you're not just waiting for the final answer at the end, But you want something like turn-level reward, potentially, where you want to be able to ensure that the model is getting credit for the mov…”
Agent RL training infrastructure must be asynchronous to avoid compute bubbles
“You also ideally want to, whether you're doing this centralized or decentralized, move in the direction of, like, everything being async and overlaps because that is, like, otherwise you have these inefficiency bubbles that, like, pop up all over your compute …”
More tool calls and web browsing yield a clear scaling curve
“Using more tool calls, searching the web more, gives you a nice scaling curve where you get better answers by putting in more effort, by, like, spending more time browsing the internet, essentially.”
Cohere used extensive asynchronous model merging to build its flagship models
“Coherent to this very extensively in their latest flagship model, command A”
Brown: OpenAI's o3 already achieves practical program synthesis
“Like when people say program synthesis, like we're already there, like O three is program synthesis, but the programs are like JSON and Python.”
Will Brown: Microsoft PowerPoint Copilot is not great
“The PowerPoint, like, Microsoft PowerPoint copilot is not great. It's not a thing that I have heard many people say saves them up time.”
Brown: AI alpha is buried in GitHub issues, X, and group chats, not LinkedIn
“There's a surprising lot of alpha still on X just from places where you don't like, so there's places I have not found much alpha on LinkedIn. The group chats, the anons the open source like GitHub discussions, lots of really good stuff is buried in like a Git…”
Will Brown: Morgan Stanley deployed integrations on day GPT-4 launched
“Like, the day GPT-IV launched, Morgan Stanley had integrations, because we had been working on it, and these were, like, we had press releases for these, like, we are ready to go”