StarZero All shows Try the podcast clipper →

Llama 3.1

part of Llama includes Llama 3.1 405B, Llama 3.1 8B, Llama 3.1 70B

5 statements across 3 episodes · 2 bullish · 0 bearish · 3 people on the record · first statement Jul 29, 2024 by Eugene Cheah · said 54 times in 9 episodes since 2024 · across every show →

Mentions by year, the whole family

brought up most by Alessio Fanelli (8), Shawn Wang (6), Nathan Lambert (3), Alistair Pullen (2), Eugene Cheah (1), Andrej Karpathy (1)

tap a year for its mentions
0025350520242025episodesmentions
03520242025episodes it came up in
0052.510520242025episodesmentions per episode
2025 11 mentions in 4 episodes 3 per episode
2024 43 mentions in 5 episodes 9 per episode

every mention, scene by scene, with the transcript →

Everything said about Llama 3.1, oldest first

Jul 29, 2024 neutral
Assertion Contradicted
Cheah: Llama 3.1 405B is first frontier model using pipeline parallelism
“This is the first major model that of this cell class size, right? They're saying, hey, we are doing pipeline parallelism.”
Eugene Cheah Jul 29, 2024 ▶ 19:21 [LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models
Jul 29, 2024 positive
Assertion Supported
Meta used stepwise reward models and Monte Carlo Tree Search for Llama 3.1
“They actually went the extra step to, no pun intended, to actually train stepwise reward models. That's kind of crazy, no? I mean, they wanted each step in the chain of thought to be so good that they actually took the extra effort to train step, to train step…”
Eugene Yan Jul 29, 2024 ▶ 34:00 [LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models
Jul 29, 2024 neutral
Prediction Not checkable as stated
Eugene Cheah: LoRAs will arrive before full Llama 3.1 405B fine-tunes
“I suspect we are going to see more LoRa's first before we get full fine-tuned.”
Eugene Cheah Jul 29, 2024 ▶ 47:54 [LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models
Jan 2, 2025 neutral
Assertion Supported
Lambert: Llama 3.1 math evals rely on SymPy and LLM judges
“Lama, 3.1 details their vows for math. They use both SIM by a Python process or Python package for extraction and it's a judge to extract their answers for math.”
Nathan Lambert Jan 2, 2025 ▶ 12:38 The State of Reasoning — from Nathan Lambert, Interconnects/AI2 [LS Live @ NeurIPS 2024]
Jul 31, 2025 bullish
Assertion Supported
Lambert: Tulu 3 matches or beats Meta Llama 3.1 on core evals
“On, like, core evals for our Suite of models from, I think, eight, seven D and four or five B is based on llama at the time. It's like it matches or beats meta on these core valves.”
Nathan Lambert Jul 31, 2025 ▶ 2:20 The RLVR Revolution — with Nathan Lambert (AI2, Interconnects.ai)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more