compute

“Then ultimately, the way you scale that compute depends on the prompt and how much, how long that is. The longer the prompt, the more compute you get. And it depends on, and there's of course many different screws to tweak here, the length of the response. The…”

“The appetite for compute is truly endless as now clearly seen, but we realized that we will need a lot. And a nonprofit was, wouldn't be the way to get there. Wouldn't be able to build a large cluster with a nonprofit.”

“For the same amount of compute, you would get a model that would be better, but also a model that will be four times cheaper to serve.”

“I mean, I think actually a significant fraction of that is going to go to compute.”

“We have enough compute to be able to train models that are as large as the largest models have been trained today to date.”

“My vision is that in the future the efficiency is very important because we are running out of data and compute. So we have to either use the data much better and use the compute much better.”

“I think, like, part of this is you can just allocate compute a lot more efficiently because you can defer stuff that the model doesn't have comparative advantage to doing to a tool that is, like, really well suited to doing that thing.”

“I think, like, there's no world in which there's enough compute to, you know, get the amount of value that we want to get out of our limbs in the next five to 10 years.”

“I know some labs have slowed down on their hiring of researchers unless they're above a very, very high bar because the cost isn't the research or it's the compute associated with the person.”