caching
2 statements across 2 episodes · 0 bullish · 2 bearish · 2 people on the record · first statement Feb 28, 2025 by Logan Kilpatrick · across every show →
Everything said about caching, oldest first
Feb 28, 2025 bearish
Embeddings will not scale for cross-session memory in real-time AI systems
“I don't think that like embeddings are going to be able to scale to, I think they work well for some of this as like kind of the MVP version of the experience, but I think you're going to need a different experience and it's Probably something like really smar…”
Sep 11, 2025 negative
Swix: Proprietary LLM caching creates vendor lock-in
“I feel like this is definitely a form of lock-in because you ideally want to be able to run prompts across multiple providers and all that. And yeah, caching is a hard problem. Like, I think ultimately, like, you control your destiny if you can run your own op…”