Natural Text Data
topic on 1 show · 1 statements across 1 episodes
1 statements about Natural Text Data, every show
LeCun: LLM scaling hits diminishing returns after exhausting natural text data
“Well, I don't know if I would call it a wall, but it's certainly a diminishing return in the sense that, you know, we've kind of run out of natural text data to train those LLMs where they're already trained with, you know, on the order of you know, 10 to the …”