Patel: Fine-tuning existing small models for cloud use is useless
Dylan Patel · The State of Silicon and the GPU Poors - with Dylan Patel of SemiAnalysis · Dec 5, 2023 · at 30:56
Dylan Patel, Chief Analyst at SemiAnalysis, discusses the economics of LLM fine-tuning versus running inference on larger frontier models.
0:00 / 0:09exact quote · 9.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Unless, unless you're fine tuning for on device use, I think fine tuning current existing models, especially the smaller ones is a useless waste of time, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dylan Patel
Dylan Patel: Political coup in Taiwan is more likely than full invasion
“What I think is most likely is that there is some sort of political coup or action. That destabilizes Taiwan in some way but doesn't actually, doesn't necessarily lead to an invasion, a full-scale invasion, and so sort of this is the best of the both worlds fo…”
Patel: China Has World's Most Advanced Standalone Chip Supply Chain
“China, China has by far the most advanced supply chain in semiconductors if you just look at China itself, right?”
Patel: Anthropic added $2B in monthly revenue at positive margins
“Anthropic doesn't just add two billion dollars of revenue in one month. You know, with, without having, you know, huge demand and they're doing it at positive margins, right?”
Patel: Google will have zero free cash flow in 2027 due to AI CapEx
“There's no reason why Google will have any profit in 27 at all, right, in terms of cash flow. They will just spend every dollar they make On, on AI infrastructure.”