big labs

4 statements across 4 episodes · 0 bullish · 2 bearish · 4 people on the record · first statement Jan 11, 2024 by Nathan Lambert · across every show →

Everything said about big labs, oldest first

Jan 11, 2024 neutral

Opinion

Lambert: Frontier Labs Lack Visibility into Cross-Model RLHF Sensitivity

“I think big labs are so over-indexed, are indexed on their own base models, so they don't know, like, what's swapping between CloudBase or GPT-IV-Base, how that would change any notion of preference or what you do with RLHF.”

Nathan Lambert Jan 11, 2024 ▶ 1:30:15 The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert

Jan 1, 2025 bearish

Assertion Not checkable as stated

Swyx: Frontier labs view new learning rate optimizers as unimportant

“Most people at the big labs who I asked about this say that it's cute, but it's not something that matters.”

Shawn Wang Jan 1, 2025 ▶ 32:08 2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents

Jan 28, 2025 neutral

Prediction Not checkable as stated

Model training from scratch will concentrate mostly in major AI labs

“As AI improves, like, fewer people probably need to train models from scratch. It gets concentrated more and more in, in different, like, in the big labs.”

Shawn Lewis Jan 28, 2025 ▶ 3:44 Beating OpenAI and Anthropic by Looking At Data: the new #1 on SWE-Bench w/ W&B CTO Shawn Lewis

Aug 29, 2025 negative

Assertion Not checkable as stated

Morcos: Major AI labs fail to holistically integrate pre-, mid-, and post-training

“Something that you don't see happen even at the big labs because they have entirely separate teams, right? There's a free training team. There's a mid training team. There's a post training team. And like the mid training team is a customer of the free trainin…”

Ari Morcos Aug 29, 2025 ▶ 52:35 Better Data is All You Need — Ari Morcos, Datology

big labs

Everything said about big labs, oldest first

Turn any episode into a week of clips.