compute

“So there's a design principle that we use, personally, at Algorithmia, which is data is heavy and expensive to move, but compute is light and cheap.”

“Storage is cheap, but compute is not. And if you are preparing your data in a data warehouse, you're using compute, and your bill is going to get pretty high.”

“I kind of think that the whole large scale model thing, It's really a gap in our scientific understanding of these models. Instead of looking at the math and coming up with a better loss function, we figured out that we could throw a compute at it, and get us …”

“I'm not an expert in the field, but I believe that this is gonna we need Another giant leap of innovation to get there. I'm not sure just throwing compute and increasing the number of GPUs without some fundamental discovery, it's gonna create this.”

“There's three layers of the stack that fundamentally are going to matter. It's energy, it's compute, and it's the intelligence built on top.”

“Inference is a big, perhaps even the majority on compute.”

“It doesn't look like we're going to suddenly end up in a regime where like you could train super intelligence with a really cheap recipe, as opposed to it being more of an iterative thing where like the cost keeps going down, the capabilities keep going up. Th…”

“Compute is the biggest constraint.”