Khosla: Massive incumbent tech giants will dominate the large language model market
Vinod Khosla · #51: Vinod Khosla on What to Build in AI · More or Less Podcast · Jun 14, 2024 · at 12:15
Venture capitalist Vinod Khosla explains to Brit Morin why foundational large language models inherently favor tech giants with massive compute clusters and proprietary data budgets.
0:00 / 0:12exact quote · 12.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Large LLMs will belong to the large players, players who can run on train on very large clusters, people who can pay for proprietary content, whether it's with Reddit or somebody else.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Vinod Khosla
Khosla: Open-source AI models will die due to massive training costs
“It is costing an order of magnitude more to train, and that's why I don't think open source models will be viable because of the training costs.”
Khosla: Open source AI models will not be viable due to training costs
“It is costing an order of magnitude more to train, and that's why I don't think open source models will be viable because the training costs.”
Khosla: AI will eventually make almost all professional human expertise essentially free
“One of my big forecasts is almost all expertise will be free.”
Khosla: Frontier AI compute costs will drop 80-90% within a year
“My bet is, a year from now, it'll cost one-fifth to one-tenth of what it does today, and my advice to all our startups is ignore the cost of compute, because any assumption you make, any dollar you spend on optimizing your software will be worthless within the…”