Shah: Supermemory outperformed Claude Code and OpenClaw benchmarks by almost 50%
Dhravya Shah · ⚡️ OpenClaw's Memory Sucks and the fix is simple — Dhravya Shah, Supermemory · Mar 9, 2026 · at 14:33
Dhravya Shah explains Supermemory's internal evaluation of different agent memory architectures.
0:00 / 0:12exact quote · 12.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So the Claude code one performed the worst, and OpenClaw slightly more than that, and SuperMemory is the highest, and you can see that, you know, it's like a pretty significant difference, like almost 50%.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dhravya Shah
Shah: Claude Code avoids indexing because vendors profit from high token usage
“They could index the code and cursor does, but plot code does not. And I believe this is also because they are not incentivized to utilize less tokens by the end user, because they're just offsetting the cost of indexing, et cetera, to tokens and time that the…”
Shah: OpenClaw memory fails because LLMs frequently skip search tool calls
“The way OpenClaw has with QMD or with whatever memory plugin you use, it inherently relies on tools to search through these memory.md files that it prepares. So, you know, like, what did I decide about the API? Then agent will decide to search, and sometimes i…”
Shah: OpenClaw's 15-message replay fails prompt caching and costs 10x more
“The way OpenClaw does it is it essentially sends back the last 15 messages in the conversation and it essentially uses that back and forth. And I mean, the approach itself is not ideal because you will, like, you are not doing any, like, you're not utilizing a…”
Shah: Most vector databases become too slow or expensive at scale
“So, so, better databases, like, at that time, and even now, except a few, like, TurboPuffer and Chroma, Were not really scalable for the scale I was getting to where they were either getting too slow or too expensive to run.”
Shah: Triplet-Based Knowledge Graphs Degrade AI Memory Performance
“And we think that triplets actually Lead to worse performance because you have to traverse them a lot to get to any information.”
Shah: LongMemEval is good but reward-hacks memory extraction volume
“LongMemival is a very good benchmark because it calculates, it tests for the right things. It tests for the right things, the data set is great, everything is really good in LongMemival, except for the fact that you can win LongMemival by remembering as many t…”