The Ledger, every show
Every statement that passed quotation and attribution checks, across all 44 shows. Pick shows below, then mix any filter with any other.
shows 
every show 44 of 44
Balaban: Most neocloud competitors cannot launch online clusters over 32 GPUs
“Most of the other NeoClouds either don't have the ability to launch a cluster from their website or max out, I'll say, 32 GPUs.”
Balaban: Practically no new US data centers use evaporative cooling
“Practically no new builds in the United States are using evaporative cooling for doing the, these closed loop direct to chip liquid cooling systems.”
Balaban: Gigawatt AI clusters require up to $45B for servers alone
“If you were to talk about the capital stack, let's say you can go back down to power generation, two to three million dollars a megawatt, two to three billion dollars a gigawatt for a power plant. The data center is between 10 and fifteen billion dollars a gig…”
Balaban: NVIDIA is the only chip provider in every major cloud
“They're the only server provider, the only chip provider that is available in every single major cloud platform, which is a huge platform advantage.”
Balaban: Top AI labs use multiple chip types for training and inference
“The biggest labs in the world are using multiple different Types of chips to do their inferencing and training on.”
Balaban: Lambda alumni startup Positron is valued over $1B
“He eventually left and joined another former Lambda team member, Thomas Summers to start Positron, which is an accelerator company. And they're like now valued at over a billion dollars.”
Balaban: Backwards pass accounts for two-thirds or more of training compute
“Generally speaking, when you're doing a training run, you might think that you might be some sort of split between the backwards pass and the forward pass on the model. And the backwards pass might be, let's say, two thirds or more of the compute and the forwa…”