StarZero All shows Try the podcast clipper →

Lin Qiao

Co-Founder & CEO, Fireworks AI · 1 appearance on the record.

computed by AI from the episodes · how this works → · full disclaimer →

founderexecutiveengineerscientist@lqiao ↗LinkedIn ↗fireworks.ai ↗

Lin Qiao previously served as a Senior Director of Engineering at Meta, where she led the engineering teams behind the PyTorch framework. In 2022, she co-founded Fireworks AI, a generative AI platform focused on inference and model serving.

12statements → 6claims → 4claims resolved → 75%fully supported → 3.92/5average certainty → 2.17/5average debate potential → ≈4.0/5argument clarity, estimated → 2said about them ↓

3 supported 1 partly supported 0 contradicted 2 not checkable as stated how the 6 claims stand · each chip opens the sources

1 prediction · 5 assertions · 1 opinion · 3 insights · 2 disclosures · every statement was checked. The prediction and assertions are the 6 claims: statements the public record can support or contradict. 4 are resolved, and 2 name no date, number or outcome precise enough to check. Everything else (opinions, insights, what ifs, disclosures) can never be settled by the record, so it carries no assessment.

The record, in short

What the tape says about how Lin argues and how the claims held up. Everything they said, and everything said about them, is in the tabs below.

Their most notable supported claim

Assertion Supported
Fireworks AI's multi-LoRA system serves up to 1,000 adapters per base model
“One base model can sustain a hundred to a thousand LoRa adapters. And then basically all these different LoRa adapters can share the same, like direct the same traffic to the same base model where base model is dominating the cost.”
Lin Qiao Nov 25, 2024 ▶ 53:45 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI

How they sound: not measured why? →

We measure speaking style by listening to the audio itself, and a fair number needs at least 2,000 words from one person on tape we have measured. There is too little of Lin Qiao on measured tape to publish a rate. This says nothing about how they speak.

Everything Lin Qiao said on Latent Space that made the record, most notable first. Filter by type, assessment or year in the ledger →

Prediction Not checkable as stated
Specialized open-source expert models will outperform one-size-fits-all closed-source models
“And that's our prediction is With specialization, there will be a lot of expert models, really, really good, and even better than, like, one size fits all open source closed source model.”
Lin Qiao Nov 25, 2024 ▶ 33:45 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Insight
AI inference matters more than training because it scales with global population
“Our prediction is for those kind of applications, the inference is much more important than training. Because inference scale is proportional to the upliminal world population. And training. Training scale is proportional to the number of researchers.”
Lin Qiao Nov 25, 2024 ▶ 8:59 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Insight
Compelling GenAI applications require compound AI systems spanning multiple modalities
“In order to really build a compelling application on top of JNI, we need a compound AI system. Compact AI system basically is going to have multiple models across modalities along with APIs, whether it's public APIs, internal proprietary APIs, storage systems,…”
Lin Qiao Nov 25, 2024 ▶ 19:41 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Disclosure
Fireworks AI will release a reasoning model inspired by OpenAI's o1
“So another announcement is we will also announce a, our next Declarative system is going to be appear as a model that has extremely high quality, and this model is inspired by O-one announcement from OpenAI. You should see that by the time we announce this o…”
Lin Qiao Nov 25, 2024 ▶ 29:26 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Opinion
Pre-training on human data is hitting limits; synthetic data is required
“So I think on the data side, we're approaching the limit and the only data to increase that is synthetic generated data.”
Lin Qiao Nov 25, 2024 ▶ 35:05 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Assertion Partly supported
Fireworks AI serves fine-tuned LoRA adapters at base model pricing
“We wrote multi LoRa last year, actually, and we actually have this function for a long time and many people have been using it, but it's not well known that, oh, if you find your model, you don't need to use on demand. If you find your model is LoRa. You can u…”
Lin Qiao Nov 25, 2024 ▶ 52:11 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Assertion Supported
Fireworks AI's multi-LoRA system serves up to 1,000 adapters per base model
“One base model can sustain a hundred to a thousand LoRa adapters. And then basically all these different LoRa adapters can share the same, like direct the same traffic to the same base model where base model is dominating the cost.”
Lin Qiao Nov 25, 2024 ▶ 53:45 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Assertion Supported
PyTorch was originally built for researchers without considering production requirements
“PyTorch actually started as the framework for researchers. Don't care about production at all.”
Lin Qiao Nov 25, 2024 ▶ 4:22 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Insight
Customer inference workloads rarely align with foundation model training distributions
“The data distribution in their inference workload doesn't align with the data distribution in the training data for the model, right? It's a given, actually. If you think about this, because researchers have to guesstimate what is important, what's not importa…”
Lin Qiao Nov 25, 2024 ▶ 15:29 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Assertion Not checkable as stated
Fireworks AI runs custom acceleration kernels for almost all served models
“For almost for all models, for all large language models, all your models.”
Lin Qiao Nov 25, 2024 ▶ 23:24 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Assertion Supported
Fireworks AI operates with a team of only forty people
“No, but only 40 people.”
Lin Qiao Nov 25, 2024 ▶ 39:12 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI
Disclosure
Fireworks AI deployed a custom workload optimization stack specifically for Cursor
“We have a unique automation stack that is one size fits one. We actually deploy to cursor early on. Basically optimize for their specific workload, and that's a lot of juice to extract out of there, and we see success in, in that product is actually can be wid…”
Lin Qiao Nov 25, 2024 ▶ 43:26 Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI

The other half of the tape: Lin Qiao's own voice is left out of every number here. Other people bring the name up 2 times in 2 episodes on Latent Space. every mention, with the transcript →

Who brings them up most Shawn Wang 1

Every mention by year

tap a year for its mentions
00111120232024episodesmentions
01120232024episodes it came up in
000.50.51120232024episodesmentions per episode
2024 1 mention in 1 episode
2023 1 mention in 1 episode

Appearances (1)

EpisodeDateSpeaking time
Why Compound AI + Open Source will beat Closed AI — with Lin Qiao, CEO of Fireworks AI Nov 25, 2024 38m
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more