LLM pre-training

1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jan 29, 2026 by Sebastian Raschka · across every show →

Everything said about LLM pre-training, oldest first

Jan 29, 2026

Insight

RLVR unlocks pre-training knowledge rather than teaching LLMs new math

“The knowledge is already there in the pre-training, and this just unlocks it. It's just like a step that maybe shows the model how to use its own knowledge, basically.”

Sebastian Raschka Jan 29, 2026 ▶ 24:33 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

LLM pre-training

Everything said about LLM pre-training, oldest first

Turn any episode into a week of clips.