The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 11 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Sequential Thinking MCP outperformed Claude 3.7 native reasoning mode in evaluations
“We tried reasoning mode as well with the new three seven. And we didn't see that much of a bump in performance. We don't know if this is something that's code specific or not. I don't have an insight. We tried both and yeah, sequential thinking worked better.”
Developers will eventually spend 80% of their time controlling agents outside IDEs
“I think in the future, at some point, my guess is that the IDE is going to become less of the focal point and more like an app that you can launch when you need to dig in deeper, but you spend most of your time away from it. So maybe 80% of your time is in a w…”
Running multiple parallel agents will unlock most value for software developers
“Being able to run multiple agents and not just one is going to be the way to unlock Honestly, most of the value out of these agents, and that's what we're working toward.”
Augment's #1 SWE-Bench agent uses off-the-shelf models, unlike their custom product
“The generation models for Sweebench, it's all off the shelf models. For the product, it includes our own custom trained models that help the model with, that help the agent with code-based understanding.”
Gur-Ari: Augment Code Achieved #1 on SWE-Bench Verified
“We just made number one on Sweepbench. So for us Sweepbench has been a useful tool for exploring how can we get the most out of agents. And so we were able to get the best result on Sweepbench verified right now.”
Engineers should begin AI feature evaluation with 10-sample interactive notebooks
“So I would say the process that I like to follow is in the beginning when developing a feature, come up with a curated set of samples. Could be as small as 10, 10 samples that you run through, and then yeah, it's all notebooks basically. You run through the sa…”
Gur-Ari uses human contractors because chat and agent evaluations resist automation
“The last thing I can mention is we use contractors for evaluation where we cannot Do automatic evaluation. So with chats and agents, it becomes way harder to do things automatically. And so we use contractors for that.”
Augment Code open-sourced the SWE-bench implementation that reached number one
“We actually open sourced our implementation of Sweebench. So if you're curious how we got to number one, you'll be able to go see all the details of how we did it.”
Augment Code runs inside the Cursor editor and already has active users
“Yes, you can use augment inside of cursor. We actually have quite a few users doing that.”
Augment Code supports MCP alongside native GitHub, Linear, and Notion integrations
“Within augment, we have we have both MCP support for complete extensibility of tools, but we, we've also built in a few first party integrations and serve them as tools to the agent. So we have GitHub linear notion that, that we use internally, and then we hav…”
Augment Code to ship multi-minute codebase orientation agent for thorough analysis
“We also have a feature that I think has not shipped yet, but we are planning to ship, which is a more thorough orientation. So this is something that will run for several minutes probably and try to do a pretty thorough job of trying to figure out You know, wh…”