Featherless AI

“The step one model is a particularly popular model for us that easily ship several contracts for us on this model alone. And no one else is.”

“You see, most providers, they only provide, let's say, less than a hundred models. That covers 50% of our inference work. It's the bottom 50% where they run all these interesting fine-tuned models that people came on board for.”

“And Federalist was meant to be a name pricing experiment. So we gave it a different name, but within the first few days, it became more profitable and more revenue than the original company platform that we were like, I guess we are Federalist now.”

“So currently the biggest will be around one to two million dollars a year, which may sound extremely large, but when you actually peel behind the layers, it only comes to around like five, six of the largest servers you see in the market.”

“We also realized that there is a lot of money on the table right now where you can go after the startups that, hey, I just built my entire startup or SMB on OpenAI or Entropic, and I'm burning a 100,000 dollars a month. And I do not know what I was doing. And …”

“Like this new AI architecture has the potential of reducing inference costs by over a thousand X.”