embeddings

6 statements across 6 episodes · 3 bullish · 3 bearish · 6 people on the record · first statement Feb 8, 2024 by Ce Zhang · across every show →

Everything said about embeddings, oldest first

Feb 8, 2024 bullish
Prediction Not checkable as stated
Zhang predicts much faster, diverse new embedding models within couple years
“So I think for the next couple years, yeah, we will see a whole bunch of new embeddings maybe of different sites, and much, much faster than today.”
Ce Zhang Feb 8, 2024 ▶ 53:29 Building an open AI company - with Ce and Vipul of Together AI
Apr 24, 2024 positive
Insight
Liu: Structured LLM outputs unlock traditional computer science reasoning algorithms
“Embeddings really is kind of like the lowest hanging fruit, and using something like Instructor can really help produce a data structure, and then you can just use your computer science to reason about this data structure.”
Jason Liu Apr 24, 2024 ▶ 26:02 High Agency Pydantic over VC Backed Frameworks — with Jason Liu of Instructor
Dec 13, 2024 negative
Insight
Mohan: Embeddings fail at complex codebase retrieval tasks like identifying quadratic algorithms
“For a lot of the systems, we do believe embeddings work, but for complex questions, we don't believe embeddings can encapsulate all the granularity of a particular query. Like imagine, imagine I have a question on a codebase of find me all quadratic time algor…”
Varun Mohan Dec 13, 2024 ▶ 23:38 Windsurf: The Enterprise AI IDE
Feb 28, 2025 bearish
Opinion
Embeddings will not scale for cross-session memory in real-time AI systems
“I don't think that like embeddings are going to be able to scale to, I think they work well for some of this as like kind of the MVP version of the experience, but I think you're going to need a different experience and it's Probably something like really smar…”
Logan Kilpatrick Feb 28, 2025 ▶ 23:41 Gemini 2.0 Flash and Flash Thinking: the new SOTA models for the agentic era
Mar 28, 2025 positive
Insight
Shah: Graph Representations Offer Observability That Vector Embeddings Lack
“They're much more discoverable. You can kind of see it. There's observability to it versus kind of embeddings, which you can't really do much with as a human. You know, once they're in there, you can't pull stuff back out”
Dharmesh Shah Mar 28, 2025 ▶ 15:31 The Agent Network — Dharmesh Shah, Agent.ai + CTO of HubSpot
Jul 23, 2025 negative
Insight
McCloy: Optimizing for semantic embeddings does not improve AI search ranking
“But I think as a tool to understand how these AI platforms are consuming your content, embeddings aren't that relevant. You're better off focusing on, like, just, again, having a good structured set of content that makes sense, like, to a human with, like, cle…”
Robert McCloy Jul 23, 2025 ▶ 39:51 AI is Eating Search
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.