SFT warmup
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement May 23, 2025 by Will Brown · across every show →
Everything said about SFT warmup, oldest first
May 23, 2025 neutral
Brown: Prompting alone cannot reliably force LLMs to use thinking tokens
“If you want models to use thinking tokens, you kind of have to, like, incentivize that. You have to either do a little bit of, like, SFT warmup, or you have to, like, Reward them for doing it. Otherwise, they will not follow it a hundred percent of the time on…”