internet data

2 statements across 2 episodes · 0 bullish · 2 bearish · 2 people on the record · first statement May 17, 2023 by Emad Mostaque · across every show →

Everything said about internet data, oldest first

May 17, 2023 negative
Opinion
Mostaque: AI developers must stop pre-training models on uncurated internet data
“We've got to stop pre-training big models on all the crazy crap of the internet. And like, we've got to do it fast because this is coming like a train.”
Emad Mostaque May 17, 2023 ▶ 1:03:13 Emad Mostaque: These 5 Companies Will Win the AI War; Why We Need National Data Sets | E1015 · 20VC with Harry Stebbings
Jun 12, 2024 negative
Assertion Partly supported
Wang: AI model training has exhausted all available internet data
“At a super super high level I think we've used up all the easy data. We've used up all of the internet data.”
Alex Wang Jun 12, 2024 ▶ 4:14 Alex Wang: Why Data Not Compute is the Bottleneck to Foundation Model Performance | E1164 · 20VC with Harry Stebbings
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.