BoolQ
product on 1 show · 2 statements across 1 episodes · said 2 times in 1 episodes since 2024
Mentions by year, every show
tap a year for its mentions
Latent Space 2
2024 2 mentions in 1 episode
every mention on every show, scene by scene, with the transcript →
2 statements about BoolQ, every show
Albrecht: Benchmark performance differences vanish once ambiguous questions are cleaned
“The main takeaway from any of the, like, actual performance is like, once you fix these ambiguous examples, a lot of these benchmarks are really saturated. Like, I think it's important to look at like, you know, like when you're talking about performance on NL…”
Albrecht: Imbue is releasing a new reasoning benchmark and 11 cleaned evaluations
“We're releasing a whole bunch of different data there, a new benchmark about code, reasoning, understanding, as well as our own private versions of 11 different open source benchmarks. So things like PoolQ or ANLI, where we've gone through and kind of cleaned …”