ARC-2
2 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jul 3, 2025 by François Chollet · said 8 times in 1 episodes since 2025 · across every show →
Mentions by year
brought up most by François Chollet (8)
tap a year for its mentions
2025 8 mentions in 1 episode
Everything said about ARC-2, oldest first
Jul 3, 2025
Chollet: Ten random people with majority voting score 100% on ARC-2
“And all tasks in Arc-II were sold by at least two other people that saw it. And each task was seen on average by about seven people. And so what that tells you is that a group of 10 random people with majority voting would score 100% on Arc-II.”
Jul 3, 2025 bearish
Chollet: Base LLMs score 0% and static reasoning scores 1-2% on ARC-2
“Well, if you take Bazel Alums, model Slack, GPT-IV-IV-V, LAMA-IV, it's simple, they get zero percent. There is simply no way to do these tasks simply via memorization. Next, if you look at static reasoning systems, so systems that use a single chain of tasks t…”