Francois Chollet

4 statements across 1 episodes · 1 bullish · 2 bearish · 1 people on the record · first statement Apr 3, 2025 by Francois Chollet · across every show →

On the record as a speaker too: Francois Chollet's record, appearances and statements → this page counts the times other people say the name.

Everything said about Francois Chollet, oldest first

Apr 3, 2025 bearish

Assertion Supported

Chollet: Latest base LLMs score zero percent on ARC-AGI-2

“Today the latest base alarms, they're doing something like 10% on ARK-I. But on Arc two, they are doing zero percent.”

Francois Chollet Apr 3, 2025 ▶ 10:50 Chasing Real AGI: Inside ARC Prize 2025 with Chollet & Knoop

Apr 3, 2025 bearish

Assertion Supported

Chollet: 50,000x LLM scaling yielded flat progress on ARC benchmark

“Because between, like, GPT-II and GPT-IV. There's been this 50,000 X scale up of base models that has resulted in, in, in basically a flat curve. On Arc.”

Francois Chollet Apr 3, 2025 ▶ 11:44 Chasing Real AGI: Inside ARC Prize 2025 with Chollet & Knoop

Apr 3, 2025 bullish

Prediction Not checkable as stated

Chollet: Commercial AI models will increasingly adopt test-time search architectures

“Increasingly, you're gonna see commercial models that use test-time search, where instead of just trying to generate one single COT to adapt to the task, they're actually gonna run through this, you know, search.”

Francois Chollet Apr 3, 2025 ▶ 9:47 Chasing Real AGI: Inside ARC Prize 2025 with Chollet & Knoop

Apr 3, 2025 neutral

Assertion Supported

Chollet: Average human test score on ARC-AGI-2 is about 60%

“Based on our own testing, an average person in our test sample would score about 60%.”

Francois Chollet Apr 3, 2025 ▶ 46:17 Chasing Real AGI: Inside ARC Prize 2025 with Chollet & Knoop

Francois Chollet

Everything said about Francois Chollet, oldest first

Turn any episode into a week of clips.