Needle In The Haystack Tests
topic on 1 show · 1 statements across 1 episodes
1 statements about Needle In The Haystack Tests, every show
Needle-in-a-Haystack Tests Are Crude for Evaluating True Context Understanding
“So it's not just having long context, it's whether your model truly understands what's inside the context, and needle in the haystack tests are pretty crude and not very effective way of testing this kind of capability.”