The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 14 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Chase: Nobody in the AI industry knows how to properly solve memory.
“I don't think anyone knows how to deal with memory, and so I think all these different approaches are...”
Harrison Chase says coding AI agents are not yet a proven success
“There's a bunch of people doing coding stuff.
We've already talked about that.
I think that's a little bit, I wouldn't say that's a success yet, but there's a lot of excitement and stuff there.”
Harrison Chase says production AI agents rely on three main defaults
“And there's such a long tail of other ones, but in practice, like, when people go to production, they generally have their own tools, or maybe one of those three, maybe some other ones, but, like, very, very few other ones.”
Chase: LangChain and other frameworks lack off-the-shelf Reflexion implementations
“I don't think we have like an off the shelf kind of like implementation of reflection and kind of like the general sense. I think the concepts like absolutely we see used in different kind of like specific cognitive architectures, but I don't think we have one…”
Harrison Chase says ReAct is the most popular agent prompting framework
“I would say like reacts probably like the most popular. I think there's aspects of reflection that Get used. Tree of thought, probably like the least so.”
Harrison Chase says TypeScript yields better LLM tool-calling performance than JSON
“I saw some paper that used TypeScript notation instead of JSON notation for tool calling and it got a lot better performance.”
Chase: Few-shot prompting works better than detailed instructions for agent trajectories
“I'm pretty bullish on it, to be honest, for a few reasons. Like, one, I think it can maybe help for more complex things, but then also, two, like, it's a form of prompting, and prompting is just Communicating with the model what you want it to do. And sometime…”
Harrison Chase says developers should guide agent planning explicitly in code
“Sometimes I say that like the LLMs aren't
[4137] Great at planning yet.
[4138] So we can help them plan by telling them how to plan and code.
[4140] Cause that's very explicit and that's a good way of communicating how they should plan and stuff like that.”
Harrison Chase admits LangChain's memory service lacked product-market fit
“The memory service we launched, I don't think really found product market fit.”
Chase: Customer support is a clear production success area for AI agents
“One big area where there's clearly been success is in customer support.
both companies doing that as a service, but also larger enterprises doing that and building that functionality inside.”
Chase: Long-term LLM memory systems must incorporate mechanisms for memory decay.
“Yeah, I think there absolutely needs to be some sort of memory decay, or some sort of, like, invalidating previous memories.”
Harrison Chase says OpenAI recommends adding a thought field to tool schemas
“I think open AI even recommended, like when you're doing tool calling, it's sometimes helpful to put like a thought field in the tool along with all the actual acquired arguments and then have that one first. So it fills out that first and then, and that's, th…”
Chase: LangGraph is adding cross-thread state persistence for agent memory
“Right now they're all persistent for a single thread.
[4392] We're going to add the ability to persist that between threads.
[4395] So then if you basically want to scope a memory to a user ID or to an assistant or to an organization, then you can do that.”
Chase: LangChain's experimental AI journaling app struggles to consolidate redundant memories.
“So one of the issues that we haven't really tackled is in this journaling app, if you notice in here, there's a bunch of ones that are really similar, right? And so, like, there's a clear kind of, like, consolidation or update or something procedure that, that…”