compute

“With the cost of system memory decreasing, memory for both storage and compute will be the exact same thing.”

“And really what drove that wasn't some fundamental discovery on the biology or the science. What drove that was Illumina was able to apply Three very specific and distinct engineering disciplines and converge them. One was the use of microfluidics, the, just a…”

“And so, I do think that compute is gonna just, I think we actually probably are underestimating the amount of compute that we're gonna soak up over the, with electricity over the next, you know, 10, 2030, 4050 years.”

“So the compute used on training a frontier system has grown four X a year for, I think like the last decade.”

“And then you have to look back and say, where is AI constrained? Right now. It's constrained in power, it's constrained on compute, it's constrained on the net, on the network.”

“I think historically we've put a little bit more on just the core algorithmic advances versus kind of the product research.”

“There's no one who's like, ah, you know, I have all the compute that I need.”

“It does seem as if most compute gets spent on inference that companies don't so far regret like using to offer their products.”

“You're just simply not going to be the low cost provider. If you're not vertically integrated, if you don't own your own compute over the very long. Long-term.”

“It takes the exact same amount of compute. All else equal to make an open source token as a, you know, frontier token for a comparably sized model. Now there's a lot of nuances there, but that's broadly true. It's just a question of what are the margins that a…”