Shah: Supermemory infrastructure costs only two cents per million tokens
Dhravya Shah · ⚡️ OpenClaw's Memory Sucks and the fix is simple — Dhravya Shah, Supermemory · Mar 9, 2026 · at 24:43
Dhravya Shah, founder of Supermemory, explains his company's unit economics and proprietary infrastructure stack.
0:00 / 0:08exact quote · 8.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“For us, we have optimized infrastructure down to, it costs us two cents for a million tokens, because we have our own model, our own database, our own everything.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dhravya Shah
Shah: Claude Code avoids indexing because vendors profit from high token usage
“They could index the code and cursor does, but plot code does not. And I believe this is also because they are not incentivized to utilize less tokens by the end user, because they're just offsetting the cost of indexing, et cetera, to tokens and time that the…”
Shah: OpenClaw memory fails because LLMs frequently skip search tool calls
“The way OpenClaw has with QMD or with whatever memory plugin you use, it inherently relies on tools to search through these memory.md files that it prepares. So, you know, like, what did I decide about the API? Then agent will decide to search, and sometimes i…”
Shah: OpenClaw's 15-message replay fails prompt caching and costs 10x more
“The way OpenClaw does it is it essentially sends back the last 15 messages in the conversation and it essentially uses that back and forth. And I mean, the approach itself is not ideal because you will, like, you are not doing any, like, you're not utilizing a…”
Shah: Most vector databases become too slow or expensive at scale
“So, so, better databases, like, at that time, and even now, except a few, like, TurboPuffer and Chroma, Were not really scalable for the scale I was getting to where they were either getting too slow or too expensive to run.”