Prediction Open AI assessment confidence: 95% certainty 3/5 debate potential 4/5

Kamradt Predicts ARC-AGI-3 Benchmark Will Remain Unbeaten For 3 Years

Greg Kamradt · ⚡️ARC-AGI-3: The Interactive Reasoning Benchmark · Jul 18, 2025 · at 28:35

Greg Kamradt, President of the ARC Prize Foundation, discusses the design durability goals for the interactive reasoning benchmark ARC-AGI-3.

0:00 / 0:06exact quote · 6.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And then V three, our durability estimate for that is three years. And that's what we're aiming for is 36 months for V three.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Greg Kamradt

Opinion
Kamradt: Any AGI Definition Involving Profit Has Ulterior Motives
“Any AGI definition that involves money has ulterior motives. I mean, simple as that. Money has nothing to do with intelligence, right?”
Greg Kamradt Jul 18, 2025 ▶ 31:25 ⚡️ARC-AGI-3: The Interactive Reasoning Benchmark
Prediction Not checkable as stated
Kamradt Predicts AGI Will Be Declared Via An Interactive Benchmark
“My hypothesis is that when AGI is declared, it will happen via an interactive benchmark. We're not going to know that AGI is here just via a static benchmark.”
Greg Kamradt Jul 18, 2025 ▶ 7:38 ⚡️ARC-AGI-3: The Interactive Reasoning Benchmark
Prediction Not checkable as stated
Kamradt Predicts AGI Will Require Heavy Scaffolding and Cooperating Components
“Now I know that sounds kind of like a weird question, but my current hypothesis that AGI will be heavily scaffolded. And why do you have that? Well, my hypothesis is that you're going to need different components that are working together in order to get the e…”
Greg Kamradt Jul 18, 2025 ▶ 15:54 ⚡️ARC-AGI-3: The Interactive Reasoning Benchmark
Insight
Kamradt: Human-Built Benchmarks Prevent AI From Reverse-Engineering Generation Code
“And the problem with that is that we don't want to incentivize AI to derive the program that made the game. Right? And so if we continue to have humans make the game, then the AI is incentivized to try to reverse engineer the G inside of humans, and that's kin…”
Greg Kamradt Jul 18, 2025 ▶ 23:07 ⚡️ARC-AGI-3: The Interactive Reasoning Benchmark
Insight
Kamradt Defines AGI as When AI Can Solve All Human-Created Tasks
“Because our hypothesis and our definition of AGI is as long as we can come up with problems that humans can do and AI cannot, then we do not have AGI. And then the flip side of that is also true, which is When us as ArcPrize, we're like, we consider ourselves,…”
Greg Kamradt Jul 18, 2025 ▶ 26:28 ⚡️ARC-AGI-3: The Interactive Reasoning Benchmark
Prediction Didn’t hold up
Kamradt Predicts ARC-AGI-2 Will Not Be Beaten For 12 Months
“My guess is it's not going to be beat for the next 12 months.”
Greg Kamradt Jul 18, 2025 ▶ 28:29 ⚡️ARC-AGI-3: The Interactive Reasoning Benchmark
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.