Leaderboard
topic on 4 shows · 4 statements across 4 episodes
Latent Space 
My First Million 
the MAD Podcast 
the a16z Podcast
4 statements about Leaderboard, every show
Angelopoulos: Chatbot Arena scores are calculated via logistic regression
“The arena score that we show on our leaderboard is a particular type of linear model, right? It's a linear model that takes, it's a logistic regression that takes model identities and fits them against human preference, right? So it regresses human preference …”
Delangue: Over 5,000 leaderboards have been created on Hugging Face
“I think we crossed 5000 leaderboards that have been created on the Hugging Face platform as a way to rank your models based on their accuracy and their performance.”
Civitai Relies on Status and Leaderboards for Creator Retention
“One of the companies that sort of focuses on fine-tuned image models and acting as a hub for that, there's a company called Civit AI. It's important for them to have a large, you know, density of fine-tuned image models. And so how do you actually, you know, e…”
Sean Puri: Rank tiering outperforms global numerical leaderboards for user retention.
“Leaderboards cool for the top 10 people, and then for everybody else on earth, it's like, oh great, I'm player number three, 39,000. Fantastic, right? And so there's all these, like, if you, I kind of studied this once, I was like, who solved this problem? And…”