AI Compute
topic on 9 shows · 21 statements across 20 episodes
No Priors
Invest Like the Best
Sourcery
Catalyst
the a16z Podcast
Big Technology
All-In
TBPN
20VC
21 statements about AI Compute, every show
Haas: Physical data center construction will be next AI compute bottleneck
“I think building out the data centers is, is going to be a bottleneck.”
O'Driscoll: Companies Must Manage AI Like Capital, Not Software Licenses
“People are going to have to control intelligence in a way that's more like how you control money and less like how you think about software licensing.”
Sacks: Political headwinds will prevent an oversupply of AI compute
“All the political headwinds, I think will almost guarantee that there's not an oversupply relative to the exponentially growing demand.”
Smith: AI compute will drive 5 BCF/day of base-case natural gas demand
“When you do that, it's about five BCF a day, we think, of very credible incremental natural gas demand associated with Mostly AI compute.”
Smith: AI gas demand could hit 12-15 BCF/day by early 2030s
“If you start to move it down, it's a P-thirty or P-zero, that number, you know, can more than double and be, you know, 12 to 15 BCF a day by the early twenty-thirties if unmitigated.”
Feldman: Real estate timelines make data center capacity a major industry limitation
“Data centers had historically moved at sort of the speed of real estate, right? Somebody would decide to build a building and two years later after permits and they poured concrete and the building would go up and two years ago nobody cared about AI. All right…”
Gerstner: Zero dark GPUs or unused compute tokens exist globally today
“There's not a dark GPU in the world today. ... There's not a dark token in the world today.”
Sinofsky: AI compute will soon experience a breakthrough transistor moment
“And, like, we are gonna have a transistor moment with all of this. It might just be more supply the way we think of it, But it also might be an actual algorithmic fundamental change. It could be a change in the hardware. There's a lot of stuff that can happen.…”
Brockman: Treat AI Compute as a Revenue Center Like Hiring Salespeople
“You can think of compute not as a cost center, but as a revenue center. Think of it a little bit like hiring salespeople. How many salespeople do you want to hire? As long as you can sell your product, as long as you have a scalable way to sell that product, t…”
Kim: Elon Musk will pitch space-based GPU satellites for SpaceX IPO
“I think Elon's pitch with the SpaceX IPO, and we'll see it in the coming months, is the AI compute, it's gonna be so, there's gonna be so much demand over the next five, 10 years, that you're gonna have to use these SpaceX satellites that have GPUs in them. To…”
Altman: Chips are currently AI's primary bottleneck over energy
“It goes back and forth. Right now, again, it's chips.”
Effectively 100% of global AI compute currently occurs in centralized cloud
“It's an energy question because the answer today is effectively a hundred percent in that first category, cloud.”
Ross: AI compute expands labor supply, an unprecedented economic shift
“The most valuable thing in the economy is labor. And now we're going to be able to add more labor to the economy by producing more compute and better AI. That has never happened in the history of the economy before.”
Sacks predicts AI advances will yield a 1,000,000x increase in capability
“So you multiply those things together. The algorithms, the chips, and then the raw compute that's available. You're talking about a million X increase, some of which will be captured in price reductions. Some of it will be in the performance ceiling, and then …”
Morin predicts AI compute will be 95% inference within five years
“In five years, I would say 95% inference, five percent training.”
Sivulka: AI compute will create $100T in market value within 60 years
“If there was a hundred trillion dollars of value that was created in the stock market from the introduction of the computer, or the fundamental unit of compute, I actually think a hundred trillion dollars of value will be created in the next 60 years from the …”
Cahn: US power supply is insufficient for AI compute demands
“We don't, and I, you know, there's sort of an interesting phenomenon here, which is, you know, the Biden administration passed the IRA, the Inflation Reduction Act, and this was this huge stimulus bill that basically incentivized everyone to build solar and bu…”
Belady: Speed of light latency forces AI into massive, centralized data centers
“I think, and again, this is probably beyond my scope, but I think it really has to do with the size of the models and the latency, right? It takes too much time for light to travel larger distances, as hard as that is to believe. And so they tend to concentrat…”