Yegge: AI coding will fragment into many specialized, fine-tuned models
Steve Yegge · The "Normsky" architecture for AI coding agents — with Beyang Liu + Steve Yegge of SourceGraph · Dec 17, 2023 · at 17:51
Steve Yegge (Sourcegraph) discusses how AI coding assistants function like recommendation engines delivering context to LLMs, drawing comparisons to YouTube and Spotify.
“And that, that fragmentation of models actually, we expected to continue and proliferate, right? Because we are fundamentally, we're a recommender engine right now. We're recommending code to the LLM. We're saying, may I interest you in this code right here so that you can answer my question. Yeah. And being good at recommender engine, I mean, who are the best recommenders, right? There's YouTube and Spotify and, you know, Amazon or whatever, right? Yeah. Yeah. And they all have many, many, many, many, many models, right? For all fine tuned for very specific, you know, and that's where we're headed in code too. Absolutely.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →