pre-training scaling law
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jan 28, 2025 by John Coogan · across every show →
Everything said about pre-training scaling law, oldest first
Jan 28, 2025 bullish
Coogan: Inference-Time Compute Establishes an Independent Scaling Law from Pre-Training
“This development creates a new scaling law that is totally independent of the original pre-training scaling law. Now you still want to train the best model you can by clearly leveraging as much compute as you can as many trillion tokens of high quality trainin…”