fine-tuning

also referred to as: fine tuning

4 statements across 4 episodes · 2 bullish · 1 bearish · 4 people on the record · first statement Apr 29, 2024 by Arthur Mensch · across every show →

Everything said about fine-tuning, oldest first

Apr 29, 2024 negative
Insight
Mensch: Current AI fine-tuning approaches are too low-level
“Like the fine tuning aspect that has been like the go-to solution is probably a little too low level from What we should be doing.”
Arthur Mensch Apr 29, 2024 ▶ 17:08 Arthur Mensch: Open vs Closed - Who Wins and Mistral's Position | E1146 · 20VC with Harry Stebbings
Sep 4, 2024 bullish
Prediction Not checkable as stated
Kolter: RAG systems will remain essential despite fine-tuning advances
“RAG based systems are so Are so common here, and so, and probably will remain, even with the advent of fine-tuning availability, they're going to remain a useful paradigm.”
Zico Kolter Sep 4, 2024 ▶ 24:33 Zico Kolter: OpenAI's Newest Board Member on The Biggest Questions and Concerns in AI Safety | E1197 · 20VC with Harry Stebbings
Feb 24, 2025 neutral
Assertion Open · timeframe Feb 2026
Morin: Google DeepMind has abandoned model fine-tuning for context windows
“You talk to people at DeepMind And they don't even fine tune anymore. Because they have such, you know, what's called big context window”
Steeve Morin Feb 24, 2025 ▶ 1:02:43 Steeve Morin: Why Google Will Win the AI Arms Race & OpenAI Will Not | E1262 · 20VC with Harry Stebbings
Aug 9, 2026 bullish
Prediction Not checkable as stated
Atallah: Model base layer fine-tuning could drop to dozens of dollars
“We might see a future where, like, when you do a fine tune, and you want to, like, change the base model layer, it only costs, like, maybe a few hundred dollars, maybe a few dozen dollars to change it.”
Alex Atallah Aug 9, 2026 ▶ 10:12 OpenRouter CEO: Why Chinese Open Models Are Beating the US | Why Enterprises Fear OpenAI & Anthropic
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.