FineWeb, every mention
9 scenes · ← back to FineWeb
tap a year for its mentions
every year anyone Shawn Wang 6Loubna Ben Allal 5Ari Morcos 4Elie Bakouch 3
Verbatim, from the transcripts: the passages where FineWeb comes up
Artificial Analysis: The Independent LLM Analysis House — with George Cameron and Micah Hill-Smith
- ▶ 54:07 Shawn Wang I mean, uh, you know, the refined web and all that stuff. 4 times in the scene
⚡ Open Model Pretraining Masterclass — Elie Bakouch, HuggingFace SmolLM 3, FineWeb, FinePDF
- ▶ 1:25 Elie Bakouch It could be, we have a team working on data, obviously with the fine web, the recently released fine PDF. 2 times in the scene
- ▶ 54:07 Elie Bakouch That's, that's what we use to, to the fine web and the fine PDF.
Better Data is All You Need — Ari Morcos, Datology
- ▶ 1:07:19 Ari Morcos We started with a combination of DCLM, Nemetron, and FineWeb. 4 times in the scene
2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
- ▶ 31:29 Shawn Wang So like in my estimation, two of the best papers in this year for data sets or data comp and refined web or fine web. 2 times in the scene
Best of 2024: Synthetic Data / Smol Models, Loubna Ben Allal, HuggingFace [LS Live! @ NeurIPS 2024]
- ▶ 3:19 Loubna Ben Allal And for example, when we were building fine web data sets here, Guilherme and Hinek were interested in like how much synthetic data is there in the web?
- ▶ 7:27 Loubna Ben Allal Tool to try to go all of fine web data sets and find the pages that are related to the topics we're interested in. 3 times in the scene
- ▶ 12:21 Loubna Ben Allal And then we run this classifier on all of fine web, which is a 15 trillion tokens data set.
The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)
- ▶ 32:27 unnamed speaker And it is better than FindWeb, which is huge because FindWeb was the sale of the art last month.