Artificial Analysis Intelligence Index, every mention
3 scenes · ← back to Artificial Analysis Intelligence Index
tap a year for its mentions
every year anyone Shawn Wang 6George Cameron 6Micah Hill-Smith 3
Verbatim, from the transcripts: the passages where Artificial Analysis Intelligence Index comes up
Artificial Analysis: The Independent LLM Analysis House — with George Cameron and Micah Hill-Smith
- ▶ 19:13 Micah Hill-Smith So first, just like background, like we're talking about the artificial analysis intelligence index, which is our synthesis metric that we pulled together currently from 10 different eval data sets to give what? 3 times in the scene
- ▶ 22:23 George Cameron Currently, the Intelligence Index and evals focus a lot on kind of raw intelligence, but we kind of want to diversify how we think about intelligence, and we can, we can talk about it, but kind of new evals that we've kind of built and… 6 times in the scene
- ▶ 1:14:52 Shawn Wang So what is going to be included in, let's say like a V three of the intelligence index, because obviously you're going to saturate. 6 times in the scene