ARC Prize, every mention
11 scenes · ← back to ARC Prize
tap a year for its mentions
every year anyone Mike Knoop 13Matt Turck 9Francois Chollet 2
Verbatim, from the transcripts: the passages where ARC Prize comes up
Chasing Real AGI: Inside ARC Prize 2025 with Chollet & Knoop
- ▶ 0:18 Matt Turck Mike was previously the co-founder and then head of AI at Zapier, and together they partnered both on the Arc Prize and on creating a new AGI research lab called Endia.
- ▶ 1:10 Matt Turck In the second part of the conversation, we discuss with Mike and Francois their big recent news, the announcement of ARK AGI-II and ARKPrize, which is often known as an IQ test for machines, which historically has tripped up LLMs from big… 2 times in the scene
- ▶ 2:00 Matt Turck Francois, the big news is the announcement of AHRQ prize, and the concurrent launch of AHRQ AGI-II, but maybe to start from the top, what is AHRQ AGI as a benchmark, and why did you create it?
- ▶ 16:45 Matt Turck Uh, on ArcG one, uh, for, for a bit, and, uh, I believe shortly after the end of, uh, uh, Arc prize, 22,024, uh, you, you guys got a call from, uh, OpenAI and OpenAI said, Hey, you know, actually our, our, uh, check, we're doing some work…
- ▶ 22:55 Matt Turck And there were some other very, um, interesting and promising approaches, uh, in ArcPrize, um, can, can you talk about those and, and more generally how that ties with your own work?
- ▶ 23:33 Francois Chollet Yeah, no, I think ArtPrize last year did a tremendous job at highlighting, you know, what are the current best approaches to create models that actually have fluid intelligence, and they're all test time adaptation methods. 2 times in the scene
- ▶ 34:58 Mike Knoop And, uh, ultimately that was kind of how we came to, uh, launch the initial version of our prize together.
- ▶ 35:22 Mike Knoop Some of the goals that we have for dark prize are to one initially was raise awareness of the fact that there was an unbeaten, really important AI benchmark out there that wasn't saturating, um, sort of resisted this, you know, 50,000 X… 6 times in the scene
- ▶ 42:38 Mike Knoop A lot of teams reach out and tell me they're very excited to actually use and try to use some of the like new deep seek like systems and the like ideas from the paper actually on our price. 6 times in the scene
- ▶ 52:25 Matt Turck I'd love to talk a little bit about India, uh, because you guys are co-founders of the ARC Prize, uh, but you're more recently, and perhaps more importantly, 2 times in the scene
- ▶ 1:00:06 Matt Turck Um, congratulations on everything you've achieved, uh, with the ARC Prize, uh, and, uh, thank you for all the work, uh, that you're doing in the industry.