embeddings
6 statements across 6 episodes · 3 bullish · 3 bearish · 6 people on the record · first statement Feb 8, 2024 by Ce Zhang · across every show →
Everything said about embeddings, oldest first
Feb 8, 2024 bullish
Apr 24, 2024 positive
Liu: Structured LLM outputs unlock traditional computer science reasoning algorithms
“Embeddings really is kind of like the lowest hanging fruit, and using something like Instructor can really help produce a data structure, and then you can just use your computer science to reason about this data structure.”
Dec 13, 2024 negative
Mohan: Embeddings fail at complex codebase retrieval tasks like identifying quadratic algorithms
“For a lot of the systems, we do believe embeddings work, but for complex questions, we don't believe embeddings can encapsulate all the granularity of a particular query. Like imagine, imagine I have a question on a codebase of find me all quadratic time algor…”
Feb 28, 2025 bearish
Embeddings will not scale for cross-session memory in real-time AI systems
“I don't think that like embeddings are going to be able to scale to, I think they work well for some of this as like kind of the MVP version of the experience, but I think you're going to need a different experience and it's Probably something like really smar…”
Mar 28, 2025 positive
Jul 23, 2025 negative
McCloy: Optimizing for semantic embeddings does not improve AI search ranking
“But I think as a tool to understand how these AI platforms are consuming your content, embeddings aren't that relevant. You're better off focusing on, like, just, again, having a good structured set of content that makes sense, like, to a human with, like, cle…”