The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 12 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Shah: OpenClaw memory fails because LLMs frequently skip search tool calls
“The way OpenClaw has with QMD or with whatever memory plugin you use, it inherently relies on tools to search through these memory.md files that it prepares. So, you know, like, what did I decide about the API? Then agent will decide to search, and sometimes i…”
Shah: OpenClaw's 15-message replay fails prompt caching and costs 10x more
“The way OpenClaw does it is it essentially sends back the last 15 messages in the conversation and it essentially uses that back and forth. And I mean, the approach itself is not ideal because you will, like, you are not doing any, like, you're not utilizing a…”
Shah: Supermemory outperformed Claude Code and OpenClaw benchmarks by almost 50%
“So the Claude code one performed the worst, and OpenClaw slightly more than that, and SuperMemory is the highest, and you can see that, you know, it's like a pretty significant difference, like almost 50%.”
Shah: Pure retrieval AI memory fails on non-literal questions
“Traditionally you have this retrieval thing that happens. So you get a question, you retrieve something, and an answer is generated based on that. But we think that it will not work for most non-literal questions, like find the best monitor for me. If I've nev…”
Shah: No other memory provider offers hybrid memory and raw RAG fallback
“Essentially, you will return the memories first, and then if there's any raw chunks that match up, we also return those to make sure the agent knows just enough information to answer the question. And no other provider does this right now”
Shah: Triplet-Based Knowledge Graphs Degrade AI Memory Performance
“And we think that triplets actually Lead to worse performance because you have to traverse them a lot to get to any information.”
Shah: Most vector databases become too slow or expensive at scale
“So, so, better databases, like, at that time, and even now, except a few, like, TurboPuffer and Chroma, Were not really scalable for the scale I was getting to where they were either getting too slow or too expensive to run.”
Shah: Supermemory infrastructure costs only two cents per million tokens
“For us, we have optimized infrastructure down to, it costs us two cents for a million tokens, because we have our own model, our own database, our own everything.”
Shah: Supermemory dynamically injects under 2,000 tokens via deterministic hooks
“So we basically turned the tools based approach to hooks based approach that actually is dealing from the super memory graph, which keeps the content fresh. So it handles updates, et cetera. So now, you know, for every tool call or for every user message, a ho…”
Shah: True LLM User Understanding Requires Four Memory Capabilities
“So, to make an LLM truly good at understanding a user, you have to handle four things. One is knowledge updates, so you have to invalidate, steal knowledge, and build on top of it, which is different from the storing vectors. You have to have some sort of temp…”