StarZero All shows Try the podcast clipper →

Sebastian Raschka

7 statements across 1 episodes · 4 bullish · 2 bearish · 1 people on the record · first statement Jan 29, 2026 by Sebastian Raschka · across every show →

On the record as a speaker too: Sebastian Raschka's record, appearances and statements → this page counts the times other people say the name.

Everything said about Sebastian Raschka, oldest first

Jan 29, 2026 bullish
Prediction Not checkable as stated
Process Reward Models will eventually become standard in LLM post-training
“I think it is promising and we will see it working at some point. I think it's just like right now it's still Tricky to make it work, but I am quite sure we'll see it as part of the standard repertoire at some point.”
Sebastian Raschka Jan 29, 2026 ▶ 26:39 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
Jan 29, 2026 bullish
Insight
Bigger LLM gains will come from multi-model process refinement, not scaling
“That's where you make the bigger gains rather than scaling the model size. I think that's one of those things where you will see more progress coming from.”
Sebastian Raschka Jan 29, 2026 ▶ 28:04 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
Jan 29, 2026 positive
Insight
Enterprises should transition from generalist LLMs to cheaper task-specific models
“If you have a business problem, you are maybe manufacturing something, maybe you can start with a generalist model, but then once you know exactly what the task is and you want to hone in on it, maybe it makes sense to replace that expensive thing by something…”
Sebastian Raschka Jan 29, 2026 ▶ 9:18 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
Jan 29, 2026 neutral
Prediction Not checkable as stated
Future LLMs will prioritize architectural efficiency over larger model sizes
“I wouldn't expect bigger architectures. I would expect a more efficient architectures tweaks getting, The same modeling performance for less compute”
Sebastian Raschka Jan 29, 2026 ▶ 17:09 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
Jan 29, 2026 positive
Assertion Partly supported
50 RLVR steps boosted Qwen 3 MATH-500 score from 15% to 50%
“I took the Quinn three model as part of my book, the reasoning from scratch book. And I trained it just for 50 steps with RLVR, and it goes from 15%, so one five percent accuracy on math 500 to 50% on math 500.”
Sebastian Raschka Jan 29, 2026 ▶ 23:58 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
Jan 29, 2026 negative
Insight
Pre-training is no longer where the low-hanging AI gains lie
“Pre-training is not dead, but pre-training is boring. So it's not where the low hanging fruit is anymore.”
Sebastian Raschka Jan 29, 2026 ▶ 17:32 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
Jan 29, 2026 negative
Disclosure
Raschka does not use LLMs to write his books or blog posts
“For blog writing on book writing, not so much because honestly, I, for fun, I tried it out. It's just, it generates okay text, but it's, I don't know, it does not I can ask it to generate text like me, but it's almost like, then I don't like it and I end up ed…”
Sebastian Raschka Jan 29, 2026 ▶ 1:04:34 State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more