LLM evaluation
also referred to as: llm evaluations
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement May 22, 2024 by Alexandr Wang · across every show →
Everything said about LLM evaluation, oldest first
May 22, 2024 positive
Alexandr Wang: Scale AI will launch recurring held-out LLM benchmark leaderboards.
“So one is that we're going to launch these private held out evaluations and have leaderboards associated with these evals for the leading LLMs in the ecosystem. And we're going to rerun this contest periodically. So every few months we're going to do a new set…”