Q size of the data centers, size of the models. And of course there is an associated Uh, energy cost that must be paid to use these things. And so I'm curious if you Emily or you Anna, Alex, Alex, you worked at Google, right? So, uh, you probably have a good sense of this. Can you both share like quantify how much energy is being used to run these models?
A So part of the problem is that even, you know, even if you're working at Google, you've, you are directly working on this. They're not very public estimates of how much cost there is. I mean, the costs vary quite widely, and the only cost I think that we know was an estimate being made by folks at Hugging Face, um, that worked on the Bloom's model because they were able to actually have some kind of insight into the energy consumption Of these models. So part of the problem is the transparency of companies on this. You know, as a response at Google after, after the Stochastic Parents paper was published, one of the complaints from people like Jeff Dean, the SVP of research at Google, and David Patterson, who's the lead author of Google's kind of rebuttal to that, was that, you know, well, you didn't factor in XYZ, you didn't factor in renewables, That only we talk about at this one data center in Iowa. We didn't, you didn't factor into off-peak training. And so it's part of the problem. I mean, we could try to put numbers on it, but there's so much guardedness about what's actually happening here. We can't quantify it. We don't know when it comes to model training. I mean, we might have something like we know the number of parameters that are in a new model. Are in an open weights model like LAMA, but, um, we don't know how many kind of fits and starts there were with stopping …
AI assessment note: “We can't quantify it. We don't know when it comes to model training.”