The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 12 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Liu: RAG is fundamentally just an algorithmic prompt-stuffing hack
“RAG is basically just a hack, but it turns out it's a very good hack because what is RAG? RAG is you keep the model fixed, and you just figure out a good way to, like, stuff stuff into the prompt of the language model. Everything that we're doing nowadays in t…”
Liu: LangChain and LlamaIndex can hit $100M revenue, but billions uncertain
“I think the bigger challenge is like, okay, a hundred million dollars, probably pretty, pretty easy. It's just time and effort. And they have both like the manpower and the money to sort of solve those problems. I think it's just like, again, if you go the VC …”
Liu: The final state for personalized AI memory will not be RAG
“I think a lot of people have thoughts about that, but, like, for what it's worth, I don't think the final state will be ragged. I think it will be some, like, fancy algorithm or architecture where you, like, bake it into, like, the architecture of the model it…”
Liu: RAG will remain essential for managing LLM cost-performance trade-offs
“There's always going to be some curve regardless of like the performance of the best performing models of like cost versus performance. And so what RAG does is it does provide extra data points along that access because you kind of control the amount of contex…”
Fanelli: LangChain and LlamaIndex usage grows on PyPI while CrewAI stays flat
“So if you look at, you know, like chain still growing. These are the last, last six months. Lama index still growing. What I've basically seen is like things that one, obviously these things have a commercial product. So there's like people buying this and sti…”
Liu: Avoid pre-GPT-4 models for tasks requiring complex reasoning
“Like, I'm one of the first to say, like, you know, you shouldn't use anything pre-GPT-IV for anything that requires, like, complex reasoning because it's just going to gonna be unreliable. Okay, disregarding stuff like fine-tuning.”
Huber: Chroma is the most used project across LangChain and LlamaIndex
“For many years running, Chrome has been the number one used project broadly, but also within communities like LinkChain and Llama Index.”
Liu: Developers should build RAG from scratch before using framework abstractions
“Building, like, RAG from scratch. I mean, I think everybody should do it, I think. Like, I would check out the guide if you guys haven't already, and I think it's in our docs, but instead of just using you know, either the kind of, like the retriever query eng…”
Liu: LlamaIndex is de-emphasizing direct revenue generation in 2023
“I think where our revenue focus this year is kind of is less emphasized. Like, it's more just about, like, can we build some managed offering that, like, provides complimentary value to what the open source library provides.”
Wang: LlamaIndex reached 600,000 monthly downloads by September 2023
“And since you're fundraising Post, which was in June. And now it's September, so it's been about three months. You've actually gained 50% in, in terms of stars and followers. You've three X your download count to 600,000 a month and your discord membership has…”
Liu: LlamaIndex closed its Greylock seed round in under a week
“What we really wanted to do was because for us, like, time was of the essence, like, we wanted to ship very quickly and still kind of build mindshare in this space, we just kept the fundraising process very efficient. I think we basically did it in, like, a we…”