LoRA Adapters
topic on 1 show · 4 statements across 3 episodes
4 statements about LoRA Adapters, every show
Fireworks AI's multi-LoRA system serves up to 1,000 adapters per base model
“One base model can sustain a hundred to a thousand LoRa adapters. And then basically all these different LoRa adapters can share the same, like direct the same traffic to the same base model where base model is dominating the cost.”
Fireworks AI serves fine-tuned LoRA adapters at base model pricing
“We wrote multi LoRa last year, actually, and we actually have this function for a long time and many people have been using it, but it's not well known that, oh, if you find your model, you don't need to use on demand. If you find your model is LoRa. You can u…”
Cosine receives larger OpenAI LoRA adapters than public tiers due to volume
“Actually we use models that are larger than what's publicly available, something publicly available yet, but when this goes out, it will be, but we have larger law adapters available to us, just because the amount of data that we're pumping through it”
Huang: LoRA merging succeeds on style but fails on complex capabilities
“Like, I will not lie to say I'm really surprised how effective it is sometimes, but I do notice that for more complex abilities other than, like, more stylistic stuff, it does, it kind of falls through, because maybe it's, it requires a much deeper path in the…”