StarZero All shows Try the podcast clipper →

Ari Morcos

10 statements across 1 episodes · 3 bullish · 2 bearish · 1 people on the record · first statement Aug 29, 2025 by Ari Morcos · said 1 times in 1 episodes since 2026 · across every show →

On the record as a speaker too: Ari Morcos's record, appearances and statements → this page counts the times other people say the name.

Mentions by year

tap a year for its mentions
0011112026episodesmentions
0112026episodes it came up in
000.50.5112026episodesmentions per episode
2026 1 mention in 1 episode

every mention, scene by scene, with the transcript →

Everything said about Ari Morcos, oldest first

Aug 29, 2025
Insight
Morcos: Complex, high-variance concepts require much more data redundancy than simple ones
“The amount of data that I need in order to properly understand dogs is going to be a lot higher than the amount of data I need to understand elephants.”
Ari Morcos Aug 29, 2025 ▶ 20:43 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025 positive
Insight
Morcos: Post-training techniques are better applied in pre- and mid-training
“Most of what we do in post-training is better were done in pre and mid training and earlier on in training in general.”
Ari Morcos Aug 29, 2025 ▶ 42:16 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025
Insight
Morcos: No universal 'golden' curation exists for AI training data
“There's no golden curation. A curation is only optimal with respect to a given set of downstream use cases or tasks, right?”
Ari Morcos Aug 29, 2025 ▶ 1:12:22 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025 positive
Insight
Morcos: Epoching high-quality data beats training on new average data
“Repeating higher quality tokens is almost always better than seeing net new lower quality tokens. So, like, epoching over higher quality data, almost always better than getting the same amount of new data of an unknown quality, or of average quality, average i…”
Ari Morcos Aug 29, 2025 ▶ 48:15 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025 negative
Insight
Morcos: Lottery ticket initializations fail because they are data dependent
“We actually found out that the problem was that the lottery ticket was actually data dependent. And that was where the fundamental problem came. That as soon as you change the data distribution a little bit, like the winning tickets changed in a really big way…”
Ari Morcos Aug 29, 2025 ▶ 1:01:14 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025 neutral
Assertion Supported
Morcos: Soft inductive biases become harmful past 1M data points in vision
“Turns out in the small data regime, and when I say small data here, I mean, say less than 500,000 data points. And this was in the context of image self-supervised learning. So in that small data regime, this is super helpful. And where this paper's actually b…”
Ari Morcos Aug 29, 2025 ▶ 6:04 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025
Insight
Morcos: Valuing data for downstream use cases is AI's NP-complete problem
“In many ways, I think that's kind of the NP-complete problem of AI. If you can do that, you can kind of do anything”
Ari Morcos Aug 29, 2025 ▶ 1:13:29 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025 neutral
Opinion
Morcos: The Transformer is just one of many equivalently good architectures
“And one of my like more controversial viewpoints, I think, is that I think the transformer is a great advance to be sure, but I think it's one of a very large Set of equivalently good architectures that we could have found. And there are many, many ways we cou…”
Ari Morcos Aug 29, 2025 ▶ 12:35 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025 positive
Insight
Morcos: Data diversity is the single most important factor in AI data quality
“If there's only one thing that you should take away from this entire interview about what is good for data quality, it's diversity.”
Ari Morcos Aug 29, 2025 ▶ 46:16 Better Data is All You Need — Ari Morcos, Datology
Aug 29, 2025 negative
Insight
Morcos: Inductive biases matter not at all at scale compared to data
“Basically, you know, when you get to enough scale, inductive biases matter not at all. All that really matters is the learned posterior from the data distribution, and that's really what defines everything.”
Ari Morcos Aug 29, 2025 ▶ 6:51 Better Data is All You Need — Ari Morcos, Datology
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more