mid-training

1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Nov 20, 2025 by Luca Soldaini · across every show →

Everything said about mid-training, oldest first

Nov 20, 2025

Insight

Soldaini: Mid-training requires re-mixing pre-training data to avoid model forgetting

“When you do that, you also need to make sure that The model doesn't forget stuff that I've seen during pre-training, so that's why, like, you mix some of the best data from pre-training, you do carry over.”

Luca Soldaini Nov 20, 2025 ▶ 50:58 Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

mid-training

Everything said about mid-training, oldest first

Turn any episode into a week of clips.