AI Model Training Data

topic on 2 shows · 3 statements across 3 episodes

the a16z Podcast 20VC

3 statements about AI Model Training Data, every show

20VC Insight
Foody: Top 20 Percent of AI Tasks Generate Majority of Model Value
“And there's oftentimes this very power law nature of data that drives model improvement in that out of a data set of 10,000 tasks, the top 2000 tasks will create majority of the value.”
Brendan Foody Jun 1, 2026 ▶ 23:51 Mercor CEO: Why Application Layer Companies Have No Moat & The Cost of Hiring AI Researchers · 20VC with Harry Stebbings
20VC Insight
AI data value follows a power law driven by top contributors
“The outcomes of data and the people that contribute to it are extremely power lot, similar to a company where if you have a hundred people on a project, oftentimes majority of the model improvement is coming from the top 10 to 20% of people, right? Just like s…”
Brendan Foody Sep 15, 2025 ▶ 13:00 Mercor CEO & Co-Founder, Brendan Foody: How They Grew from $1M to $500M in 17 Months · 20VC with Harry Stebbings
a16z Prediction Not checkable as stated
Wang: AI development will shift to scientific, targeted data additions
“We're gonna have to get pretty scientific around, You know, exactly what is the model not capable of today? And therefore, what are the exact kinds of data that need to be added to improve the model's performance?”
Alexandr Wang Sep 24, 2024 ▶ 10:01 Why Human Data is Key to AI: Alexandr Wang from Scale AI

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.