Current AI model leaderboards reward response style over actual factual correctness
Sebastian Raschka · State of LLMs 2026: RLVR, GRPO, Inference Scaling — Sebastian Raschka · Jan 29, 2026 · at 40:08
AI researcher Sebastian Raschka explains why model performance on public AI leaderboards often fails to translate into real-world performance gains.
0:00 / 0:05exact quote · 5.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“It rewards the style more, more than the correctness because there is no correctness check.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sebastian Raschka
Text diffusion models will not replace autoregressive Transformers at state-of-the-art
“So it is a interesting direction to go into these diffusion, diffusion models as alternative to the auto regressive transformers, but it is not I would say the replacement at the state of the art.”
Future LLMs will prioritize architectural efficiency over larger model sizes
“I wouldn't expect bigger architectures. I would expect a more efficient architectures tweaks getting, The same modeling performance for less compute”
Pre-training is no longer where the low-hanging AI gains lie
“Pre-training is not dead, but pre-training is boring. So it's not where the low hanging fruit is anymore.”
RLVR unlocks pre-training knowledge rather than teaching LLMs new math
“The knowledge is already there in the pre-training, and this just unlocks it. It's just like a step that maybe shows the model how to use its own knowledge, basically.”