Oleve avoids third-party AI frameworks in favor of native SDKs
Sid Bendre · Tiny Teams: $6m ARR, 5m users with 4 employees — Sid Bendre, Oleve (Quizard AI/Unstuck AI) · Apr 23, 2025 · at 21:51
Sid Bendre, CTO of consumer AI company Oleve, discusses their engineering architecture and philosophy regarding LLM orchestration frameworks.
0:00 / 0:14exact quote · 14.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Because it's so critical to know what goes into your prompt. I think it's been very important for us to like sort of like manually, like own those prompts, i.e. Like build the integrations ourselves and build those like workflows ourselves. So we haven't really like used a lot of like other like frameworks outside of that.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sid Bendre
Consumer software startups will increasingly operate like distribution-first CPG brands
“Our thesis on consumer software now is, it's gonna be It's going to reflect less or look less like our operating consumer technology companies is going to look less like traditional tech companies and more like CPG companies that were like very much distributi…”
Prompt routing scales better than model routing as base models improve
“For us, we've actually like figured that the like unit, the like The return on it was not actually that beneficial. What makes sense for us instead is, you know, like we use base models for like the final, like response. What makes sense, what makes more sense…”
Oleve repurposes LaunchDarkly feature flags to load balance LLM endpoints
“What we do is we use the stage roll, like we use LaunchDarky flags to route between different Azure, Azure OpenAI endpoints setting up the percentages ourselves. And so now like every new request is a random, like a new like user effectively. And so it comes i…”
Oleve reports $6M ARR, 5M users, and sustained profitability
“And so now across the portfolio, we do all, we do five million users. We had six million dollars in ARR and we've been profitable since the first nine months of operating.”
Oleve is building a shadow organization staffed by AI agents
“What I'm trying to do with the platform is start up an internal shadow org within the company, and that's all run by agents. Effectively staffing like each business unit with agents, you know, our growth and marketing especially being the highest priority, but…”