FineWeb

product on 2 shows · 2 statements across 2 episodes · said 20 times in 7 episodes since 2024

Latent Space 19 the MAD Podcast 1

Mentions by year, every show

tap a year for its mentions
0052103202420252026episodesmentions
023202420252026episodes it came up in
0021.543202420252026episodesmentions per episode

Latent Space 19the MAD Podcast 1

2026 4 mentions in 1 episode
2025 9 mentions in 3 episodes 3 per episode
2024 7 mentions in 3 episodes 2 per episode

every mention on every show, scene by scene, with the transcript →

2 statements about FineWeb, every show

Morcos: Curation gains stack multiplicatively and preserve relative dataset advantages
“If we apply our curation on top of say DCLM, and then we apply it on top of FineWeb, the gap between FineWeb and DCLM is maintained in the gap between kind of Datology curated DCLM and Datology curated FineWeb. They both get a lot better, but Datology DCLM is …”
Ari Morcos Aug 29, 2025 ▶ 1:09:07 Better Data is All You Need — Ari Morcos, Datology
LATENT SPACE Disclosure
Hugging Face Filtered 15T Token Dataset Down to 1.5T Educational Tokens
“And then we run this classifier on all of fine web, which is a 15 trillion tokens data set. And then we only keep the pages that have like a score that's higher than three. So for example, in our case, we went from 15 trillion tokens to just 1.5 trillion token…”
Loubna Ben Allal Dec 24, 2024 ▶ 12:21 Best of 2024: Synthetic Data / Smol Models, Loubna Ben Allal, HuggingFace [LS Live! @ NeurIPS 2024]

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.