test-time compute

also referred to as: test time compute

5 statements across 3 episodes · 4 bullish · 0 bearish · 3 people on the record · first statement Apr 21, 2025 by Charles Packer · across every show →

Everything said about test-time compute, oldest first

Apr 21, 2025 bullish
Insight
Packer: Sleep-time compute during idle downtime is a major missed opportunity
“And practically speaking, you know, machines, they're not like humans, they can be run all the time. And there's a ton of downtime, both in advance of like questions being asked also like After questions have been asked too. So I think beyond just scaling at t…”
Charles Packer Apr 21, 2025 ▶ 1:02 Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)
Apr 21, 2025 neutral
Assertion Not checkable as stated
Packer: Nobody in the AI industry is actively scaling sleep-time compute
“How much we really can kind of take advantage of sleep time compute, which is effectively completely on mine today. Like nobody's really Scaling in the sleep time compute direction.”
Charles Packer Apr 21, 2025 ▶ 12:38 Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)
Jun 19, 2025 bullish
Insight
Brown: Reasoning models improve primarily through compute efficiency rather than longer thinking duration
“These models are becoming more efficient in the way they're thinking, as they're able to do more with the same amount of test time compute, and I think that's a very underappreciated point, that it's not just that we're getting these models to think for longer…”
Noam Brown Jun 19, 2025 ▶ 1:08:26 Scaling Test Time Compute to Multi-Agent Civilizations — Noam Brown, OpenAI
Jun 19, 2025 bullish
Disclosure
Brown: OpenAI team is scaling test-time compute to hours and days
“The team, in many ways, is actually a misnomer, because we're working on more than just multi-agent. Multi-agent is one of the things we're working on. Some other things we're working on is just like being able to scale up test time compute by a ton. So how, y…”
Noam Brown Jun 19, 2025 ▶ 41:59 Scaling Test Time Compute to Multi-Agent Civilizations — Noam Brown, OpenAI
Aug 29, 2025 positive
Insight
Morcos: Test-time compute fundamentally favors smaller models to cut multi-step inference costs
“Test time compute as a paradigm really pushes you towards smaller models, right? Because if your cost of solving a problem is cost of inference times number of thinking steps, and you have to do a lot of thinking steps. Well, now this is like a really like min…”
Ari Morcos Aug 29, 2025 ▶ 1:04:35 Better Data is All You Need — Ari Morcos, Datology
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.