Baseten

“What we're seeing now is that, like, copilots, especially cogen stuff that actually has already made its way into the enterprise. Like, most enterprises we talk to, like, when you say, when you ask them how advanced are you on their AI strategy, they'll tell y…”

“We work with companies like Descript where AI is very, very core to the product experience. We power a lot of AI features that Patreon has shipped.”

“At the end of 2022, most of our customers were using T-folds and AT&Gs. You know, after that it changed to A-one hundreds. Now it's going to H-one hundreds. Like the computer needs aren't necessarily going down. They're only going up, especially as these servi…”

“I think customers are still struggling with availability for the most premium chips. And I think, you know, whether that's eight, 108, 100, I think even when there is availability, you're oftentimes looking for like three to six weeks of negotiating with cloud…”

“I think short term you know, it's really hard for me to see how we make investments beyond NVIDIA, especially when there's a customer, where there's like customer A crunch on the other side from customers who are like, hey, we need this now.”

“I'd say, 95% of the tokens today are on the first business, and almost all of them there's probably a, yeah, for almost all of them, the customer is making some modifications to the model with their own data specialized for the use case, and I think what's eve…”

“There are a, there's a subset of tasks, which I think is small today, where people really start to start with cost. But everyone comes from capability first, because that's really where the economic growth is being unlocked, where the value is being delivered,…”

“None of our top 30 customers have ever churned. You know, we're talking Like, 400% annual NDR around our business, and so it's like very, it's very, very sticky.”

“There's probably, like, a dozen good, like, clouds, and I'd probably, like, put, like, three or four of them in, like, the gold tier and I think that just means that, like, supply, like, not only are we supply crunched, we're supplier and operationally crunche…”

“Somewhat disentangling pre-fill and decode and starting to treat them as separate problems. I think that's, you know, something we are very focused on, and we're seeing massive gains there.”

“If you feel like you are micromanaging, if you feel like you need, if you feel like, you know, you have to be involved in everything, I think that's a bit of a cop-out as a founder, because you're just like, I just need to be involved in everything. It's like,…”

“We run them in, like, uncomfortably high utilization. You know, we, when I'm saying we're like mid-nineties utilization most of the time there is, we have made, we have, we sit in 18 different clouds now. We have 90 clusters around the world across 18 differen…”

“I think if you look by inference count, it'd be 99% the full.”

“You guys have grown 30 X over the last year.”