Inferencing

“If you are, for example, building one large data center that only does training and it's not connected to a wide area network around the world, that's close to the users, it's hard to use that same infrastructure For inferencing because you can't go faster tha…”

“Like if you look at just 2024, we've reduced the cost of inferencing, and you can see it in our prices of the models by a factor of 20 times.”