Test Time Compute Scaling
topic on 2 shows · 2 statements across 2 episodes
2 statements about Test Time Compute Scaling, every show
Reddy: Test-time scaling currently works best for verifiable domains like math
“It seems like OpenAI has cracked a version of this that works, and we think A, Foundation Model Labs will come up with better ways of doing this, and B, so far it largely works for very verifiable domains, things that look like math and physics and maybe secon…”
Elad Gil compares OpenAI's o1 model to the GPT-2 stage
“Yeah, it's kind of like GPT-II for that approach, and the idea is that that could scale further over time, and it's kind of the initial early proof point that you feel like something really real is happening. And then it's just going to be subject to the same …”