why aren't all 16 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Opinion
Liu: LangChain and LlamaIndex can hit $100M revenue, but billions uncertain
“I think the bigger challenge is like, okay, a hundred million dollars, probably pretty, pretty easy. It's just time and effort. And they have both like the manpower and the money to sort of solve those problems. I think it's just like, again, if you go the VC …”
Opinion
Chase: Nobody in the AI industry knows how to properly solve memory.
“I don't think anyone knows how to deal with memory, and so I think all these different approaches are...”
Insight
Martin: Multi-agent systems excel at parallel read-only tasks, not writing tasks
“I like the take that apply multi-agents to problems that are easily parallelizable, that are read-only, for example, context gathering for deep research, and do, like, the final quote-unquote write, in this case report writing, at the end. I think this is tric…”
Assertion Supported
Mlejnsky: LangChain gets 20 million monthly downloads and remains popular
“Well, I have a, I have, I don't know if this is an unpopular opinion, but, like, people keep telling me, ah, Langchain isn't popular, but if you look at its stats, like, it has twenty million downloads per month. How can you have not popular framework when it …”
Prediction Held up
Colvin: Pydantic AI will be first framework implementing OpenTelemetry GenAI attributes
“I suspect Pedantic AI will be the first agent framework that implements those semantic attributes properly, because again, we control Pedantic AI, and we can say this is important for observability, whereas most of the other agent frameworks are not maintained…”
Assertion Supported
Fanelli: LangChain and LlamaIndex usage grows on PyPI while CrewAI stays flat
“So if you look at, you know, like chain still growing. These are the last, last six months. Lama index still growing. What I've basically seen is like things that one, obviously these things have a commercial product. So there's like people buying this and sti…”
Assertion Supported
Huber: Chroma is the most used project across LangChain and LlamaIndex
“For many years running, Chrome has been the number one used project broadly, but also within communities like LinkChain and Llama Index.”
Disclosure
Florent Crivello: Lindy is to LangChain as Airtable is to MySQL
“We are a no-code platform letting you build your own AI agents easily. So you can think of, we are to Langchain as Airtable to MySQL. Like you can just pin up AI agents super easily by clicking around and no code required. You didn't have to be an engineer and…”
Assertion Supported
Chase: LangChain and other frameworks lack off-the-shelf Reflexion implementations
“I don't think we have like an off the shelf kind of like implementation of reflection and kind of like the general sense. I think the concepts like absolutely we see used in different kind of like specific cognitive architectures, but I don't think we have one…”
Insight
Harrison Chase says production AI agents rely on three main defaults
“And there's such a long tail of other ones, but in practice, like, when people go to production, they generally have their own tools, or maybe one of those three, maybe some other ones, but, like, very, very few other ones.”
Opinion
Harrison Chase says ReAct is the most popular agent prompting framework
“I would say like reacts probably like the most popular. I think there's aspects of reflection that Get used. Tree of thought, probably like the least so.”
Disclosure
Harrison Chase admits LangChain's memory service lacked product-market fit
“The memory service we launched, I don't think really found product market fit.”
Assertion Supported
Harrison Chase says TypeScript yields better LLM tool-calling performance than JSON
“I saw some paper that used TypeScript notation instead of JSON notation for tool calling and it got a lot better performance.”
Insight
Liu: Developers should build RAG from scratch before using framework abstractions
“Building, like, RAG from scratch. I mean, I think everybody should do it, I think. Like, I would check out the guide if you guys haven't already, and I think it's in our docs, but instead of just using you know, either the kind of, like the retriever query eng…”
Disclosure
Rizk: Wondercraft has never used LangChain
“You know, I like Langchain. Never used it. Never ever used it.”
Disclosure
Chase: LangChain's experimental AI journaling app struggles to consolidate redundant memories.
“So one of the issues that we haven't really tackled is in this journaling app, if you notice in here, there's a bunch of ones that are really similar, right? And so, like, there's a clear kind of, like, consolidation or update or something procedure that, that…”