curriculum learning
2 statements across 2 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement May 31, 2024 by Mark Huang · across every show →
Everything said about curriculum learning, oldest first
May 31, 2024 positive
Huang: Curriculum context expansion outperforms full-length training from scratch
“If you train a model on a shorter context and you progressively increase that context to, like,
You know, the final limit that you have, like, 32 K is usually the limit of Lama two was that long.
It actually performs better than if you try to train 32 K the …”
Aug 26, 2026 positive
Curriculum learning enables multi-physics AI fine-tuning with significantly fewer samples
“And now there's coupling, like because of heat, there's also stretching or kind of the joint phenomena. You could like now hope to fine tune with much fewer samples because it kind of individually knows this phenomena. Then combining them together, maybe it ca…”