Everything Evan Conrad said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Conrad: Hyperscalers will probably lose significant money reselling Nvidia GPUs
“My intuition is that the hyperscalers are probably going to lose a lot of money, and they know they're going to lose a lot of money on reselling NVIDIA GPUs at least.”
Conrad: Decentralized compute networks will never beat co-located InfiniBand clusters
“I just don't really think this is gonna ever be more efficient than a fully interconnected cluster with Infiniband, or, you know, whatever sort of next spec might be. Like, I could be completely wrong, but Speedolite is really hard to beat. And regardless of w…”
Conrad: The AI VC bubble will pop and fail to return capital
“So what you've done by not having a future is you've inflated the venture capital market. And that is a bubble that's totally going to pop at some point. Like a lot of the companies are not going to work. And the valuations are not going to work. And what's go…”
Conrad: Software margins on GPU clusters drive customers to build in-house
“So if you have a 10% margin increase because you have great software on your billion dollars, the customers are that price sensitive. They will immediately switch off if they can, because why wouldn't you? You would just take that hundred million dollars, you'…”
Conrad: CoreWeave's debt-financed long-term contract model is optimal for GPUs
“So that means that the best way to make money in GPUs was to do basically exactly what CoreWeave did which is go out and sign only long-term contracts, pretty much ignore the bottom end of the market completely, and then maximize your long-term contracts with …”
Conrad: GPU businesses succeed as pure real estate or pure software, not both
“The GPU clouds are fantastic real estate businesses. If you treat them like real estate businesses, you will make a lot of money. The, Cloud services you can make on that, all the software you want to make on that, you can do that fantastically. If you don't o…”
Conrad: SF Compute is the only true liquid bid-ask GPU market
“Turned into what is today SF compute, which is a compute market, which we think we are the functionally the most liquid GPU market of any capacity. Honestly, I think we're the only thing that actually is like a real market that there's like bids and asks and t…”
Conrad: GPU market will likely return to a shortage by winter
“My general prediction is that like by the winter we will be back towards shortage, but then also this very much depends on
The rollout of future chips.”
Conrad: OpenRouter open-source traffic required only around 10 H100 nodes
“The entirety of Open Router that was not Anthropic or Google like, or Gemini or OpenAI or something. It was like, 10 H 100 nodes or something like that. It's just, like, not that much. It's like, not that many GPUs, actually, to service that entire demand.”
Conrad: Incremental GPUs always drive model performance and revenue, unlike CPUs
“Gusto isn't going to make like, you know, five percent more money. They're going to make zero, like literally zero money from every incremental GPU or CPU after a certain point. This is not the case for anyone who is training models. And it's not the case for …”
Conrad: Custom chips make sense for inference, not training experimentation
“It only works if you really know which chip you're going to do. If you don't, then it's a little harder. So it makes, in my head, it makes more sense for inference where you've already established it, but for training there's so much, like, experimentation.”
Conrad: Test-time inference will significantly expand inference compute demand
“The thing I do feel reasonably confident about saying is that the test time inference is probably going to quite significantly expand the amount of compute that was used for inference.”
Conrad: VCs trading compute for equity is credit risk arbitrage
“And so the hack of a VC or some capital partner offering equity for compute is always some arbitrage on the credit risk.”
Conrad: SF Compute plans cash-settled futures to de-risk data centers
“What we're trying to do is create an underlying spot market that gives you an index price that you can use. And then with that index price, you can create a cash settled future. And with a cash settled future, you can go back to the data centers and you can sa…”
Conrad: Compute Spot Markets Fail Without Direct Control and Cluster Auditing
“You really cannot make a smart market work if you don't run the clusters, if you don't have control over them, if you don't know how to audit them, because these are super computers, not soybeans.”
Conrad: Mental health apps face near-zero retention if they work
“Quirk had the same problems that basically every mental health app has, which is like your retention goes to zero if you work it in any capacity.”
Conrad: Selling short-term GPU contracts is the worst financial model
“Selling short-term contracts for low prices paid over time which is the worst place to be in the worst financial place to be in because it has the highest interest rate which means that your costs go up at the same time, your incoming cash goes down and squeez…”
Conrad: NVIDIA launching a cloud would impair hyperscaler sales
“If they launched their own core weave, then it would make it much harder for them to sell to the hyperscalers.”
Conrad: NVIDIA avoids customer concentration to prevent hyperscaler price setting
“It's really bad for NVIDIA if you have customer concentration, and Microsoft and Google and Amazon, like, Oracle to, like, buy up your entire supply and then you have four or five customers or so who pretty much get to set prices.”
Conrad: Spot GPU cluster utilization nears 100% through dynamic price clearing
“Assuming there are not, like, hardware problems or software problems, the utilization rate is, like, near a hundred percent, because the price dips until the utilization is a hundred percent.”
Conrad: GPU clouds cannot offer contract cancellation without risking capital costs
“If you're just the GPU cloud, you can never cancel your contract because that introduces so much risk that you would otherwise like not get your cheap cost capital or whatever.”
Conrad: Grad students are the worst customers for traditional GPU clouds
“And the grad students are like the worst possible customer for the traditional GPU clouds, because they will immediately turn if you sell them a thing, because they're going to graduate and then like, I'm going to go anywhere or they're not going to like, that…”
Conrad: HPC Hardware Reliability Issues Are Unlikely to Disappear
“Like the hardware problems aren't going away until the underlying vendors fix things. But honestly, I don't think that's likely because you're always pushing the limits at HPC. This is the case of trying to build a supercomputer”