Foreign Data Set
topic on 1 show · 1 statements across 1 episodes
1 statements about Foreign Data Set, every show
Foreign Language Data Degrades English Benchmark Scores on Small LLMs
“Adding in a foreign data set is actually a loss, because once you're below a certain param count, so we're talking about the seven important, right? The more you add that's more in line with your evals, the more it will degrade, and they just exclude it.”