ARC benchmark
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Apr 6, 2025 by Mike Knoop · across every show →
Everything said about ARC benchmark, oldest first
Apr 6, 2025 bearish
Knoop: ARC Saw No Progress Despite 50,000x Model Scaling
“Surprise that it basically hadn't, and not only hadn't been beaten, there'd basically been no progress in it which I thought was really fascinating given the fact that we've like scaled up these language model systems by almost like 50,000 times over the last,…”