Sourcegraph

“We have like nine of the 10 top Public tech companies as customers and like four of the six top banks and like Uber and Stripe and so on, all these companies using Sourcegraph for code search.”

“Their product has a great reputation of just being, like, you know, punching way above its weight, but I think the other thing that I really respect is that they helped initiate this whole, like, standardization around, like, agents.md and, like, dot agents sl…”

“It's growing more than 50% month over month, a lot faster in, you know, some weeks.”

“So we have teams with like two or three people that are on annual run rates of like hundreds of thousands of dollars.”

“It just so happens that we are positive gross margins along the way.”

“So there's a lot of things on AMP that we do, like no consistent pricing, no user model choice, no checking off all the boxes that security and compliance and legal want that, you know, takes nine months. We're able to get away without doing that stuff because…”

“I think we're around eight people now on the AMP core team, and we still don't do formal code reviews. We still push to main. We still ship 15 times every day.”

“We had, like, an internal poll last week at our company meetup where Beyang was asking who of you uses the CLI and who of you uses VS Code, and it was a fifty-fifty split”

“So we've had one head to head loss with Amp where we lost against the usual players. And the reason why is one of them discounted their other product a hundred percent for two years. The other one discounted at 85% for two years, which is just crazy.”

“Instead of having the client log and having the browser log and having the database log, let's have one unified log, because then it's easier for the agent to just look at this log and make sense of it. And then it turns out it doesn't have to be nicely format…”

“What we're seeing now with agents is as soon as somebody has seen what it can do, they have such a multiplying effect or this brings so much value that people are willing to adopt the code base for this. Like the first time in how many decades where people are…”

“And we've had non coders, including one of our board members who built something with AMP that replaced like 250 K a year piece of software that he used for a lot of their internal fund tracking.”

“I think we don't have any set evals. We don't. And this was controversial up until a week ago, I think, when I think Boris from Or two weeks ago from Anthropix that they don't have evals for the coding agent too. But we don't, and we haven't had them.”

“I think we both realized that we're spending a lot of our time in the process of reading and understanding the existing code rather than building new features. Cause all that is a prerequisite for Being able to build quickly and efficiently.”

“Your model architecture can only go so far if your data is, is garbage. So you really need a high quality data pipeline, and that means not only having, you know, in our domain, high quality code that can serve as the underlying data to use, but also a way to …”

“Doing the simple thing, it establishes a baseline. Like oftentimes you'll find that like the doing the fancier thing is often sexier. And it's certainly these days it's like trendier, right? Cause you can kind of claim the mantle of like, ah, you know, I made …”

“The primary model that Cody uses for inline completions right now is StarCoder seven billion. And with the benefit of context that actually matches the performance of you know, larger proprietary models.”

“If your goal is to build software as it exists today, then yes, I think in the future, a single human will be able to build applications that today require large numbers of people to coordinate.”

“And so I still think we will have large teams of software developers in the future. They will just You know, each individual will be responsible for far more feature scope than they are today, and the system as a whole will be more sophisticated and more power…”

“Everyone uses a range of model. No, like, no one uses the same model for, like, inline completion versus, like, chat because the latency requirements were.”

“Like today, Cody uses StarCoder for inline completions, and with the benefit of the context that we provide, we actually show, like, comparable completion acceptance rate metrics. It's kind of like the standard metric that folks use to evaluate inline completi…”

“And that, that fragmentation of models actually, we expected to continue and proliferate, right? Because we are fundamentally, we're a recommender engine right now. We're recommending code to the LLM. We're saying, may I interest you in this code right here so…”

“The skill with which models are able to take advantage of context is always going to be dependent on how that factors into the impact on the training loss, right? So like, If you want long context window models to work well, then you have to have a ton of data…”

“We're actually a little bit, I think, more bearish than the average, you know, AI hypefluencer out there on the feasibility of agents with purely kind of like transformer-based models.”

“We're not going in the agent direction, right? I mean, I'll believe in agents when somebody shows me one that works.”

“And I don't think the AI developer will be any different. It will need to pull context from all these different sources.”

“I feel like most models today, they still use, like, combination of, like, the stack and the pile as, like their training corpus but you can only stretch that so far. At some point, we need more data and I don't know. I think there's still more alpha in, like,…”

“The real problem of modern software development, I think is, is not how quickly can you write more lines of code. It's really about managing the emergent complexity of code bases as they evolve and grow, and how to get, how to make like efficient development t…”

“As far as I know, Cody is, is the only AI enabled editor assistant or coding tool today that, that fetches context as kind of like as broadly as we do.”

“Like that's the code graph that we spent the past 10 years building. And we can do that essentially in any language, any code base at compiler level accuracy.”

“And while we don't have one that's like completely self-hostable yet, I think, you know, with all the interesting things happening around, you know, llama, alpaca and that sort of thing, I think like within six months we'll, we'll have like a viable language m…”