foreign data set
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Aug 31, 2023 by Eugene Cheah · across every show →
Everything said about foreign data set, oldest first
Aug 31, 2023 neutral
Foreign Language Data Degrades English Benchmark Scores on Small LLMs
“Adding in a foreign data set is actually a loss, because once you're below a certain param count, so we're talking about the seven important, right? The more you add that's more in line with your evals, the more it will degrade, and they just exclude it.”