open source models

“We are going to start publishing some of our research that we're doing with the labs or the other providers and open sourcing more models, more of the work we're doing.”

“There's customers like us, where we do need to move some of our traffic to open source models because it's just becoming super expensive to serve like the largest closed frontier model.”

“Increasingly, it's not just which model is the best. It's which model can solve the task at the lowest price point, because as these models get better, there's kind of intelligent saturation where it's like, okay, for some simple tasks, I actually want to know…”

“The open source models are about three to three to six months behind the frontier models, right? But they're 99% cheaper for inference.”

“Enterprise LLM spend was 19% open source last year, and it's 11% this year. So it's dropped.”

“Well, I think open source models are going to dominate AI inferencing. You know, you'll see in the next two years, we'll shift to where's almost no open source to where's going to be almost all open source.”

“We've seen some customers maybe six months ago or a year ago, they'll take an open source model and fine tune it or something. And then, you know, they're now like, okay, this is like, shit, this is like really behind and it's like nightmare to maintain and I …”