Augment Code

“We actually open sourced our implementation of Sweebench. So if you're curious how we got to number one, you'll be able to go see all the details of how we did it.”

“Yes, you can use augment inside of cursor. We actually have quite a few users doing that.”

“So I would say the process that I like to follow is in the beginning when developing a feature, come up with a curated set of samples. Could be as small as 10, 10 samples that you run through, and then yeah, it's all notebooks basically. You run through the sa…”

“We tried reasoning mode as well with the new three seven. And we didn't see that much of a bump in performance. We don't know if this is something that's code specific or not. I don't have an insight. We tried both and yeah, sequential thinking worked better.”

“I think in the future, at some point, my guess is that the IDE is going to become less of the focal point and more like an app that you can launch when you need to dig in deeper, but you spend most of your time away from it. So maybe 80% of your time is in a w…”

“Being able to run multiple agents and not just one is going to be the way to unlock Honestly, most of the value out of these agents, and that's what we're working toward.”

“The last thing I can mention is we use contractors for evaluation where we cannot Do automatic evaluation. So with chats and agents, it becomes way harder to do things automatically. And so we use contractors for that.”

“Within augment, we have we have both MCP support for complete extensibility of tools, but we, we've also built in a few first party integrations and serve them as tools to the agent. So we have GitHub linear notion that, that we use internally, and then we hav…”

“The generation models for Sweebench, it's all off the shelf models. For the product, it includes our own custom trained models that help the model with, that help the agent with code-based understanding.”

“We also have a feature that I think has not shipped yet, but we are planning to ship, which is a more thorough orientation. So this is something that will run for several minutes probably and try to do a pretty thorough job of trying to figure out You know, wh…”

“We just made number one on Sweepbench. So for us Sweepbench has been a useful tool for exploring how can we get the most out of agents. And so we were able to get the best result on Sweepbench verified right now.”