StarZero All shows Try the podcast clipper →

Jerry Liu

Co-founder & CEO, LlamaIndex · 1 appearance on the record.

computed by AI from the episodes · how this works → · full disclaimer →

founderexecutiveengineerscientist@jerryjliu0 ↗LinkedIn ↗jerryjliu.github.io ↗

Jerry Liu created GPT Index in 2022 and co-founded LlamaIndex, a data framework and enterprise platform for retrieval-augmented generation applications. Before founding LlamaIndex, he conducted autonomous driving research at Uber ATG, engineered feed ranking systems at Quora, and led machine learning monitoring efforts at Robust Intelligence.

13statements → 4claims → 0claims resolved → 3.54/5average certainty → 2.54/5average debate potential → ≈4.0/5argument clarity, estimated → 3said about them ↓

1 not yet assessed 3 not checkable as stated how the 4 claims stand · each chip opens the sources

3 predictions · 1 assertion · 1 opinion · 6 insights · 2 disclosures · every statement was checked. The predictions and assertion are the 4 claims: statements the public record can support or contradict. 0 are resolved, 1 is not yet assessed, and 3 name no date, number or outcome precise enough to check. Everything else (opinions, insights, what ifs, disclosures) can never be settled by the record, so it carries no assessment.

The record, in short

What the tape says about how Jerry argues and how the claims held up. Everything they said, and everything said about them, is in the tabs below.

How they sound: not measured why? →

We measure speaking style by listening to the audio itself, and a fair number needs at least 2,000 words from one person on tape we have measured. There is too little of Jerry Liu on measured tape to publish a rate. This says nothing about how they speak.

Everything Jerry Liu said on Latent Space that made the record, most notable first. Filter by type, assessment or year in the ledger →

Insight
Liu: RAG is fundamentally just an algorithmic prompt-stuffing hack
“RAG is basically just a hack, but it turns out it's a very good hack because what is RAG? RAG is you keep the model fixed, and you just figure out a good way to, like, stuff stuff into the prompt of the language model. Everything that we're doing nowadays in t…”
Jerry Liu Oct 12, 2023 ▶ 24:45 RAG is a hack - with Jerry Liu of LlamaIndex
Insight
Liu: RAG will remain essential for managing LLM cost-performance trade-offs
“There's always going to be some curve regardless of like the performance of the best performing models of like cost versus performance. And so what RAG does is it does provide extra data points along that access because you kind of control the amount of contex…”
Jerry Liu Oct 12, 2023 ▶ 15:01 RAG is a hack - with Jerry Liu of LlamaIndex
Prediction Open · timeframe Oct 2028
Liu: Developers will eventually fine-tune new factual knowledge into LLMs
“That's one of those things where I think long-term, you definitely can. I think some people say you can't. I disagree. I think you definitely can. Just right now, I haven't gotten into work yet.”
Jerry Liu Oct 12, 2023 ▶ 29:53 RAG is a hack - with Jerry Liu of LlamaIndex
Insight
Liu: Improving vector store lookup algorithms offers low marginal gains
“I don't think the delta on, like, improving the vector store, like, embedding lookup algorithm is that high. I think this stuff has been mostly solved or at least there's just a lot of other stuff you can do to try to improve the overall performance.”
Jerry Liu Oct 12, 2023 ▶ 1:01:34 RAG is a hack - with Jerry Liu of LlamaIndex
Prediction Not checkable as stated
Liu: The final state for personalized AI memory will not be RAG
“I think a lot of people have thoughts about that, but, like, for what it's worth, I don't think the final state will be ragged. I think it will be some, like, fancy algorithm or architecture where you, like, bake it into, like, the architecture of the model it…”
Jerry Liu Oct 12, 2023 ▶ 1:10:29 RAG is a hack - with Jerry Liu of LlamaIndex
Insight
Liu: Avoid pre-GPT-4 models for tasks requiring complex reasoning
“Like, I'm one of the first to say, like, you know, you shouldn't use anything pre-GPT-IV for anything that requires, like, complex reasoning because it's just going to gonna be unreliable. Okay, disregarding stuff like fine-tuning.”
Jerry Liu Oct 12, 2023 ▶ 9:28 RAG is a hack - with Jerry Liu of LlamaIndex
Opinion
Liu: Security and access control are not P0 for enterprise apps
“I think users have asked for it, but I don't think that's like a P zero. Like, I think the P zero is more on, like, can we get this thing working before we expand this to, like, more users within the org.”
Jerry Liu Oct 12, 2023 ▶ 34:32 RAG is a hack - with Jerry Liu of LlamaIndex
Prediction Not checkable as stated
Liu: Fine-tuned LLMs will become the primary scalable evaluation solution
“No, but these models will get better and you'll probably fine tune a model to be a better judge. I think that's probably what's going to happen. So I'm like reasonably bullish on this because I don't think there's really a good alternative beyond you just huma…”
Jerry Liu Oct 12, 2023 ▶ 1:06:00 RAG is a hack - with Jerry Liu of LlamaIndex
Insight
Liu: Chain-of-thought query decomposition produces superior retrieval results
“Another example here is actually LLM based reasoning, like LLM based chain of thought reasoning. You can take a question, break it down into smaller components and use that to actually send to your retrieval system. And that gives you better results since kind…”
Jerry Liu Oct 12, 2023 ▶ 47:53 RAG is a hack - with Jerry Liu of LlamaIndex
Disclosure
Liu: LlamaIndex is de-emphasizing direct revenue generation in 2023
“I think where our revenue focus this year is kind of is less emphasized. Like, it's more just about, like, can we build some managed offering that, like, provides complimentary value to what the open source library provides.”
Jerry Liu Oct 12, 2023 ▶ 53:23 RAG is a hack - with Jerry Liu of LlamaIndex
Insight
Liu: Developers should build RAG from scratch before using framework abstractions
“Building, like, RAG from scratch. I mean, I think everybody should do it, I think. Like, I would check out the guide if you guys haven't already, and I think it's in our docs, but instead of just using you know, either the kind of, like the retriever query eng…”
Jerry Liu Oct 12, 2023 ▶ 1:12:32 RAG is a hack - with Jerry Liu of LlamaIndex
Disclosure
Liu: LlamaIndex closed its Greylock seed round in under a week
“What we really wanted to do was because for us, like, time was of the essence, like, we wanted to ship very quickly and still kind of build mindshare in this space, we just kept the fundraising process very efficient. I think we basically did it in, like, a we…”
Jerry Liu Oct 12, 2023 ▶ 16:12 RAG is a hack - with Jerry Liu of LlamaIndex
Assertion Not checkable as stated
Liu: 90% of users ask how to improve LLM app performance
“Honestly, 90% of users I talk to have questions about how to improve the performance of their app.”
Jerry Liu Oct 12, 2023 ▶ 37:08 RAG is a hack - with Jerry Liu of LlamaIndex

The other half of the tape: Jerry Liu's own voice is left out of every number here. Other people bring the name up 3 times in 3 episodes on Latent Space. every mention, with the transcript →

Who brings them up most Jason Liu 1

Every mention by year

tap a year for its mentions
00112220242025episodesmentions
01220242025episodes it came up in
000.511220242025episodesmentions per episode
2025 1 mention in 1 episode
2024 2 mentions in 2 episodes 1 per episode

Appearances (1)

EpisodeDateSpeaking time
RAG is a hack - with Jerry Liu of LlamaIndex Oct 12, 2023 53m
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more