pre-training
2 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Nov 24, 2025 by Epoch AI Researcher · across every show →
Everything said about pre-training, oldest first
Nov 24, 2025 neutral
David Owen: AI pre-training receives less focus due to post-training progress
“It seems as if pre-training is comparatively less of a focus than it was before, partly because, like, you have this exciting new direction of, well, new, newish direction of post-training where they've done so much about reasoning”
Nov 24, 2025 positive
David Owen: Post-training usage data generates feedback loops for pre-training
“A lot of this stuff is quite synergistic. You develop a better model. You, like, use post-training stuff to make it better. You get a load of data of the model actually being used successfully or not. A lot of that can probably go into pre-training next time.”