Product Specific Evals
topic on 1 show · 1 statements across 1 episodes
1 statements about Product Specific Evals, every show
Husain: General LLM benchmarks do not correlate with product-specific evals
“Up until now, a lot of the big labs understandably focused on general benchmarks, like MMLU score, human eval, things like that, which are very important for foundation models. And, you know, those not very related to product specific evals, like the ones we t…”