GPU Compute
topic on 7 shows · 9 statements across 9 episodes
Acquired 
Lenny's Podcast 
My First Million 
No Priors 
Invest Like the Best 
Big Technology 
20VC
9 statements about GPU Compute, every show
Midha: Tech Is in a GPU Wastage Bubble, Not an AI Bubble
“We're not in an AI bubble for sure. I'll tell you that, which is the question I keep getting asked. We are definitely in a GPU wastage bubble where there are stranded pockets of compute, like billions of dollars of compute that are sitting unutilized.”
Tiwari: Sovereign AI Projects Often Lack Local Expertise to Scale GPU Compute
“And so those are the two nuances I think with Sovereigns is they need to find players that can rapidly scale compute In the, in their countries, and oftentimes they don't necessarily have these players that know how to build and scale GPU compute.”
Patel: OpenAI and Meta waste massive amounts of compute exploring architectures
“They're wasting a ton of compute. They were, you know, maybe they still are, but you know, like, and everyone's wasting compute, right? OpenAI's wasting tons of compute. Because, you know, what's the Pareto optimal model architecture? Who knows?”
Levie: AI coding will be the killer app for token volume
“Coding is, is definitely the one that is like, you know, this incredible, like, you know, one person could cause thousands of dollars per day of GPU expense if they really want it. So I think this is going to be the killer app for the foreseeable future in ter…”
Dines: Scaling GPU compute with current algorithms will not yield godlike AI
“Look, I think it's, it would be an easy investment if there is a predictable outcome, but I don't, do you really think that just adding GPUs and with the existing algorithm to train, they will suddenly become, become godlike, intelligent? I don't understand. A…”
Doshi: AWS Quoted 5x Market Price for GPUs in 2023
“I mean, we look, we were looking for compute last year and AWS wanted to charge us five times more for the same GPU than 10 different providers all around them.”
Puri: AI will drop porn COGS down to GPU costs
“I think for the companies, you drop your cogs down, right? So like, you don't have to worry about all the takedown notices and copyright issues and lawsuits that you're gonna, that you have from people uploading stolen works or having to share revenue with all…”
Predominant enterprise AI GPU compute consumption will occur via the cloud
“It looks like the predominant way that companies are going to use that compute is gonna be in the cloud.”
High GPU compute costs force AI startups to monetize from day one
“One big difference between AI startups and others is it's actually quite expensive to operate an AI startup in terms of the compute resources, like running this stuff in these GPU machines is quite expensive. So typically these companies need to have a monetiz…”