Monte Carlo Tree Search
also referred to as: mcts
3 statements across 3 episodes · 2 bullish · 0 bearish · 3 people on the record · first statement Jul 29, 2024 by Eugene Yan · across every show →
Everything said about Monte Carlo Tree Search, oldest first
Jul 29, 2024 positive
Meta used stepwise reward models and Monte Carlo Tree Search for Llama 3.1
“They actually went the extra step to, no pun intended, to actually train stepwise reward models. That's kind of crazy, no? I mean, they wanted each step in the chain of thought to be so good that they actually took the extra effort to train step, to train step…”
Jan 2, 2025 positive
Lambert: OpenAI o1 uses large-scale RL on verifiable outcomes, not MCTS
“You should take open AI at their face value, which they are doing very large scale RL on the verifiable outcomes is what I've added, especially in context of the RL API that they've released, which I'll talk about more, but most of the reasons to believe in mo…”