Code And Math Data
topic on 1 show · 1 statements across 1 episodes
1 statements about Code And Math Data, every show
Bakouch: Hugging Face introduces code and math in 1T+ token phase
“We are basically introducing higher quality data like I don't know where it is, but if you look at the different phase, we are basically adding more code and math through the train and less web data. But we're only doing it like one point trillion token.”