Trojanowski: DeepSeek-R1 succeeded by scaling outcome supervision over process supervision
“If you look, you know, if you fast forward a bit and you look at the, like the DeepSeq R-one paper where they effectively laid out, you know, what I think all the labs were doing at that time, or at least OpenAI was doing in terms of you know, RLVR reasoning f…”
Bissell: CCP bias is identifiable in Qwen and DeepSeek-R1 representation spaces
“Well, there's, there are certainly internal, yeah, parts of the representation space where you can sort of see where that lives.”
DeepSeek-R1 cost roughly $300,000 to train, 10x cheaper than DeepSeek-V3
“Deep seek version three, they had like a five million dollar price tag on that given the, I think two dollars per GPU, they assume whether that's a correct assumption or not it's a different question, but if you compare it relative to the cost of R one, I thin…”
Ai2 fine-tuned OLMo 3 using Chinese teacher models DeepSeek-R1 and Qwen
“So in our case, we took a mix of existing data sets like Open Thoughts three and modified it, which is from Bespoke AI labs, a startup. And then we also generated a whole bunch of new data. So we ended up using a mix of teachers from like Deep Seek R one, oh f…”
Lambert: SimpleQA benchmark scores drop across reasoning models tested without tools
“You look at all the evals from reasoning models, and one of the trends is that, like simple QA numbers all drop. It's like DeepSeq R-one to the new R-one, it goes down. It's like all the new, like, QN-II to QN-III, simple QA goes down, at least when you're eva…”
Lambert: Reasoning models solved basic skills; planning is the next frontier
“So I came up with four and the foundational one was skills, which is What I would say that we have already done with O-one and R-one, which is you do a lot of RL, you show the inference time scaling works and you get really high benchmark numbers. And then the…”
Lambert: DeepSeek-R1 starts solving math questions immediately without explicit planning
“If you look at DeepSeq R-One and you ask it a hard math question, it's not like, here's my plan of attack. It just starts.”
Packer: Sleep-time compute offers Pareto improvements across Claude 3.7 and DeepSeek
“It's like pretty consistent across like both 3.7 deep seek, three mini, which all like the way you actually scale the x-axis here is fundamentally quite different in each case with 3.7 extended thinking mode. The parameter you provide to scale it is different …”
Mascorro: DeepSeek-R1 proved reinforcement learning improves models without human feedback
“And I think the big thing in, in R-one, or generally with these reasoning models is, We were doing before there was a human in the loop always, right? Like when we have this SFT training and these other techniques that we're doing after like RLHF and having R …”
Appenzeller: DeepSeek-R1-Zero is arguably better at reasoning than the final R1
“DeepSeq R-one-zero is actually a very, very good reasoning model. It's arguably better in reasoning than the final DeepSeq R-one.”
Mascorro: DeepSeek-R1 post-training used two SFT and two RL phases
“So basically the way they did that, trying to fix R one zero, is it added a couple more phases in the post-training. That included two supervised fine tuning phases and two reinforcement learning phases. And these reinforcement learning phases, they were a lar…”
Mascorro: Distillations from DeepSeek-R1 Outperformed Direct RL on Smaller Models
“So it turns out in their experiments, they took Lama's EV and some of these are QN models, and they basically apply RL straight the same way they did it with R one on these base models. And it turns out that it improved in some fields, but it was not a signifi…”
Roucher: DeepSeek-R1 ranks slightly below OpenAI o1 on smolagents tasks
“I tried R one, but R one is a bit under O one with small agents. And I think this is also a matter of formatting. Like sometimes the model struggles to just output them, the code snippets in the correct way that we expect.”
Casado: DeepSeek Reasoning Traces Enable Model Distillation for Edge Devices
“It turns out that that chain of thought, if you have access to that, it allows you to train smaller models very quickly and very cheaply, and that's called distilling. So like the general, Term of distilling in LLM world means you have a teacher model, train a…”
Fernando: DeepSeek R1 Is Open Source and on Par with OpenAI o1
“Like they've made it open source so that it's available for us to study but it's apparently also on par with ChatGPT's like O-one model, O-one's reasoning models.”
Fernando: GPT-4o natively understands audio and tone, unlike DeepSeek R1
“So one thing I just learned very recently about GPT-IV and ChatGPT's Omni models is the fact that this model's breakthrough, a little bit different than R-I, is the fact that it can actually understand audio and tone and all these extra implications that we do…”
Ross: DeepSeek R1 won't be talked about in six months
“Are we going to be talking about DeepSeq for the next six, or R-one for the next six months? And the answer is absolutely not.”
Ross: DeepSeek R1 proves base AI models are commoditized
“This has just made it absolutely nakedly clear that the models are commoditized, right?”
Coogan: DeepSeek R1 failed prompt length test compared to OpenAI o1 Pro
“O-One Pro delivered basically exactly 5000 words, and it even, as it was writing the story, it would say like, introduction, 400 words. Act one, 600 words. And it totally, it kept this like internal log, and then at the end it was like, I have written 5400 wor…”
DeepSeek-R1 researchers found MCTS and Process Reward Models were not useful
“R-one specifically said, yes, we tried MCTS. Yes, we tried PRMs. And none of that is useful.”