Khosla: Open-source AI models will die due to massive training costs
Vinod Khosla · #51: Vinod Khosla on What to Build in AI · More or Less Podcast · Jun 14, 2024 · at 8:48
Vinod Khosla explains why escalating training expenses will make open-source foundation models unviable compared to proprietary offerings.
0:00 / 0:10exact quote · 10.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“It is costing an order of magnitude more to train, and that's why I don't think open source models will be viable because of the training costs.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Vinod Khosla
Khosla: Open source AI models will not be viable due to training costs
“It is costing an order of magnitude more to train, and that's why I don't think open source models will be viable because the training costs.”
Khosla: AI will eventually make almost all professional human expertise essentially free
“One of my big forecasts is almost all expertise will be free.”
Khosla: Frontier AI compute costs will drop 80-90% within a year
“My bet is, a year from now, it'll cost one-fifth to one-tenth of what it does today, and my advice to all our startups is ignore the cost of compute, because any assumption you make, any dollar you spend on optimizing your software will be worthless within the…”
Khosla tells his portfolio startups to completely ignore AI compute costs
“My advice to all our startups is ignore the cost of compute, because any assumption you make, any dollar you spend on optimizing your software will be worthless within the year, and so forget about it.”