EvalGen
product on 1 show · 2 statements across 1 episodes · said 11 times in 2 episodes since 2024
Mentions by year, every show
tap a year for its mentions
Latent Space 11
every mention on every show, scene by scene, with the transcript →
2 statements about EvalGen, every show
Yan: Annotators must update past grades when evaluation criteria drift
“If you find that your criteria has drifted, instead of trying to maintain the same criteria, And aligning to the previous grades. Instead, what we should do is we should revisit those previous grades and fix it because it's an iterative process.”
Yan: EvalGen requires fewer assertions than SPADE for comparable evaluation
“Evalgen only needed three assertions, be quote assertions, or LLM prompts. So essentially, it needed less than spade, which needed five to get comparable results. Now, when we look at the product pipeline we see that evalgen only requires four assertions, whic…”