Base LLMs
topic on 2 shows · 2 statements across 2 episodes
the Y Combinator Startup Podcast
20VC
2 statements about Base LLMs, every show
Chollet: Base LLMs score 0% and static reasoning scores 1-2% on ARC-2
“Well, if you take Bazel Alums, model Slack, GPT-IV-IV-V, LAMA-IV, it's simple, they get zero percent. There is simply no way to do these tasks simply via memorization. Next, if you look at static reasoning systems, so systems that use a single chain of tasks t…”
LeCun: Open LLMs will become infrastructure and create net new jobs
“The scenario I think will happen, and I'm certainly waiting for is the scenario I described earlier, where you have some sort of open platform for base LLMs. So base LLMs basically would be seen as a basic infrastructure like, you know, TCP, IP, Linux, Apache,…”