natural text data
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Mar 19, 2025 by Yann LeCun · across every show →
Everything said about natural text data, oldest first
Mar 19, 2025 negative
LeCun: LLM scaling hits diminishing returns after exhausting natural text data
“Well, I don't know if I would call it a wall, but it's certainly a diminishing return in the sense that, you know, we've kind of run out of natural text data to train those LLMs where they're already trained with, you know, on the order of you know, 10 to the …”