Oleve periodically de-indexes unused user files to curb vector DB costs
Sid Bendre · Tiny Teams: $6m ARR, 5m users with 4 employees — Sid Bendre, Oleve (Quizard AI/Unstuck AI) · Apr 23, 2025 · at 23:35
Sid Bendre, CTO of Oleve, explains how the team minimizes Azure AI Search storage limits caused by users testing novelty queries once.
0:00 / 0:24exact quote · 24.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“What we do have is we actually have a D indexer that runs like every like few days where basically we look at the index, we look at what's like being put in there and what hasn't been used in a while and we take it off. And the moment somebody like tries triggered again, we immediately reloaded back in there. And this has helped us like keep from needing to like scale in a crazy way because we've basically like We basically erase all the novelty tests, like files off of the index and only keep the things that people are like frequently using”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sid Bendre
Consumer software startups will increasingly operate like distribution-first CPG brands
“Our thesis on consumer software now is, it's gonna be It's going to reflect less or look less like our operating consumer technology companies is going to look less like traditional tech companies and more like CPG companies that were like very much distributi…”
Prompt routing scales better than model routing as base models improve
“For us, we've actually like figured that the like unit, the like The return on it was not actually that beneficial. What makes sense for us instead is, you know, like we use base models for like the final, like response. What makes sense, what makes more sense…”
Oleve repurposes LaunchDarkly feature flags to load balance LLM endpoints
“What we do is we use the stage roll, like we use LaunchDarky flags to route between different Azure, Azure OpenAI endpoints setting up the percentages ourselves. And so now like every new request is a random, like a new like user effectively. And so it comes i…”
Oleve reports $6M ARR, 5M users, and sustained profitability
“And so now across the portfolio, we do all, we do five million users. We had six million dollars in ARR and we've been profitable since the first nine months of operating.”
Oleve is building a shadow organization staffed by AI agents
“What I'm trying to do with the platform is start up an internal shadow org within the company, and that's all run by agents. Effectively staffing like each business unit with agents, you know, our growth and marketing especially being the highest priority, but…”