The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 14 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Srivastava: AI-Native Startups Represent 99% of Total Inference Call Volume
“I think if you look by inference count, it'd be 99% the full.”
Srivastava: 95% of Tokens on Baseten Run on Custom Modified Models
“I'd say, 95% of the tokens today are on the first business, and almost all of them there's probably a, yeah, for almost all of them, the customer is making some modifications to the model with their own data specialized for the use case, and I think what's eve…”
Srivastava: Only 3 or 4 Global Cloud Providers Belong in Gold Tier
“There's probably, like, a dozen good, like, clouds, and I'd probably, like, put, like, three or four of them in, like, the gold tier and I think that just means that, like, supply, like, not only are we supply crunched, we're supplier and operationally crunche…”
Srivastava: Founder micromanagement indicates having the wrong team
“If you feel like you are micromanaging, if you feel like you need, if you feel like, you know, you have to be involved in everything, I think that's a bit of a cop-out as a founder, because you're just like, I just need to be involved in everything. It's like,…”
Srivastava: Baseten is avoiding non-NVIDIA hardware investments in the short term
“I think short term you know, it's really hard for me to see how we make investments beyond NVIDIA, especially when there's a customer, where there's like customer A crunch on the other side from customers who are like, hey, we need this now.”
Srivastava: AI companies choose models by capability before optimizing cost
“There are a, there's a subset of tasks, which I think is small today, where people really start to start with cost. But everyone comes from capability first, because that's really where the economic growth is being unlocked, where the value is being delivered,…”
Srivastava: Baseten Maintains 400% Annual NDR and Zero Top-30 Customer Churn
“None of our top 30 customers have ever churned. You know, we're talking Like, 400% annual NDR around our business, and so it's like very, it's very, very sticky.”
Srivastava: Baseten Runs 90 Clusters Across 18 Clouds at Mid-90s Utilization
“We run them in, like, uncomfortably high utilization. You know, we, when I'm saying we're like mid-nineties utilization most of the time there is, we have made, we have, we sit in 18 different clouds now. We have 90 clusters around the world across 18 differen…”
Srivastava: Customer compute demands continuously escalate to A100s and H100s
“At the end of 2022, most of our customers were using T-folds and AT&Gs. You know, after that it changed to A-one hundreds. Now it's going to H-one hundreds. Like the computer needs aren't necessarily going down. They're only going up, especially as these servi…”
Srivastava: Securing H100s still requires weeks of provider negotiations and escalations
“I think customers are still struggling with availability for the most premium chips. And I think, you know, whether that's eight, 108, 100, I think even when there is availability, you're oftentimes looking for like three to six weeks of negotiating with cloud…”
Srivastava: Disentangling Pre-fill and Decode Yields Massive Performance Gains
“Somewhat disentangling pre-fill and decode and starting to treat them as separate problems. I think that's, you know, something we are very focused on, and we're seeing massive gains there.”
Srivastava: Most enterprises start AI adoption with developer copilots
“What we're seeing now is that, like, copilots, especially cogen stuff that actually has already made its way into the enterprise. Like, most enterprises we talk to, like, when you say, when you ask them how advanced are you on their AI strategy, they'll tell y…”