ARC-AGI
also referred to as: arc agi
3 statements across 1 episodes · 1 bullish · 2 bearish · 1 people on the record · first statement Jun 11, 2024 by Mike Knoop · said 10 times in 1 episodes since 2024 · across every show →
Mentions by year
brought up most by Mike Knoop (10)
tap a year for its mentions
2024 10 mentions in 1 episode
Everything said about ARC-AGI, oldest first
Jun 11, 2024 bearish
Knoop: ARC-AGI benchmark performance only moved from 20% to 34% in four years
“There's an AI lab called lab 42 out of Switzerland that's been running a small annual contest over the last four years to try and beat this eval and state of the art today is. 34% state of the art four years ago when it was first introduced was 20%. So we've m…”
Jun 11, 2024 bearish
Knoop: ARC solution will likely need under 10k code lines, not massive LLMs
“It's quite likely actually that the solution it can be like written in like 10,000 lines of code or less. And it's not gonna require these like, you know, gigantic You know, two hundred billion large parameter models in order to solve it.”