needle in the haystack
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Mar 28, 2024 by Harrison Chase · across every show →
Everything said about needle in the haystack, oldest first
Mar 28, 2024 neutral
Chase: Needle-in-a-haystack benchmarks fail to represent real RAG reasoning
“That, that actually really doesn't reflect a lot of RAG use cases in, in my opinion, because like that's the needle in the haystack is like, okay, given this long context, can I find a single information point? But oftentimes RAG is about seeing multiple infor…”