FineWeb
2 statements across 2 episodes · 1 bullish · 0 bearish · 2 people on the record · first statement Dec 24, 2024 by Loubna Ben Allal · said 19 times in 6 episodes since 2024 · across every show →
Mentions by year
brought up most by Shawn Wang (6), Loubna Ben Allal (5), Ari Morcos (4), Elie Bakouch (3)
tap a year for its mentions
2026 4 mentions in 1 episode
2025 9 mentions in 3 episodes 3 per episode
Everything said about FineWeb, oldest first
Dec 24, 2024 neutral
Hugging Face Filtered 15T Token Dataset Down to 1.5T Educational Tokens
“And then we run this classifier on all of fine web, which is a 15 trillion tokens data set. And then we only keep the pages that have like a score that's higher than three. So for example, in our case, we went from 15 trillion tokens to just 1.5 trillion token…”
Aug 29, 2025 positive
Morcos: Curation gains stack multiplicatively and preserve relative dataset advantages
“If we apply our curation on top of say DCLM, and then we apply it on top of FineWeb, the gap between FineWeb and DCLM is maintained in the gap between kind of Datology curated DCLM and Datology curated FineWeb. They both get a lot better, but Datology DCLM is …”