ANLI, every mention
2 scenes · ← back to ANLI
tap a year for its mentions
every year anyone Josh Albrecht 2
Verbatim, from the transcripts: the passages where ANLI comes up
State of the Art: Training 70B LLMs on 10,000 H100 clusters
- ▶ 7:36 Josh Albrecht So things like PoolQ or ANLI, where we've gone through and kind of cleaned up the data as much as possible by looking at all the ones that models get wrong or that are flagged for ambiguity.
- ▶ 1:01:55 Josh Albrecht I think it's important to look at like, you know, like when you're talking about performance on NLI or race or pool cue or something like what you're really talking about is like performance on questions that make no sense.