Insight certainty 4/5 debate potential 3/5

Dohmke: Most company codebases are too small for meaningful fine-tuning

Thomas Dohmke · GitHub CEO: The AI Coding Gold Rush, Vibe Coding & Cursor · Jun 12, 2025 · at 26:52

Thomas Dohmke, CEO of GitHub, explains why fine-tuning AI models on internal enterprise repositories yields poor results.

0:00 / 0:07exact quote · 7.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“If you look at the individual repository or set of repositories, that code base isn't actually big enough to have a meaningfully fine tuned model.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Thomas Dohmke

Prediction Not checkable as stated
Dohmke: No single AI model will ever dominate software development
“There is never going to be one single model that rules them all, but the world of software development is just way too broad for this.”
Thomas Dohmke Jun 12, 2025 ▶ 23:29 GitHub CEO: The AI Coding Gold Rush, Vibe Coding & Cursor
Insight
Dohmke: Context-aware AI agents with tool calls outperform fine-tuned models
“So this iterative process that the agent does with the help of the tool calls in all the context makes it so much more powerful than a fine-tuned model could ever be.”
Thomas Dohmke Jun 12, 2025 ▶ 29:03 GitHub CEO: The AI Coding Gold Rush, Vibe Coding & Cursor
Prediction Not checkable as stated
Dohmke: Seamless developer-to-agent transition is key to winning AI dev tools
“Enabling developers to move between those categories and being able to pick the agent That provides the best ROI or do it themselves. I think that's the key for winning in the next few years.”
Thomas Dohmke Jun 12, 2025 ▶ 36:42 GitHub CEO: The AI Coding Gold Rush, Vibe Coding & Cursor
Prediction Not checkable as stated
Dohmke: AI coding agents require 90% benchmark accuracy for broad adoption
“90% is going to be the min bar for broad adoption and saying this is now established technology and we need to look for the next big thing.”
Thomas Dohmke Jun 12, 2025 ▶ 51:57 GitHub CEO: The AI Coding Gold Rush, Vibe Coding & Cursor
Prediction Not checkable as stated
Dohmke: Primary developer skill will become task specification for AI agents
“And then the skill of the developer will be to know how to describe the task in such a way that the agent can do the job with almost no additional revisions needed.”
Thomas Dohmke Jun 12, 2025 ▶ 55:15 GitHub CEO: The AI Coding Gold Rush, Vibe Coding & Cursor
Prediction Not checkable as stated
Dohmke: Simple software replaced by prompts will lose value
“Everything that I can easily replace with a single prompt is, is not going to have any value. It will have the value of that prompt and the inference and the tokens, but that's often a few dollars.”
Thomas Dohmke Jun 12, 2025 ▶ 1:02:34 GitHub CEO: The AI Coding Gold Rush, Vibe Coding & Cursor
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.