The Ledger, every show

“There is never going to be one single model that rules them all, but the world of software development is just way too broad for this.”

“Enabling developers to move between those categories and being able to pick the agent That provides the best ROI or do it themselves. I think that's the key for winning in the next few years.”

“90% is going to be the min bar for broad adoption and saying this is now established technology and we need to look for the next big thing.”

“And then the skill of the developer will be to know how to describe the task in such a way that the agent can do the job with almost no additional revisions needed.”

“Everything that I can easily replace with a single prompt is, is not going to have any value. It will have the value of that prompt and the inference and the tokens, but that's often a few dollars.”

“But we think, you know in 20, 25, we get into a place where you can assign a GitHub issue, a well-defined GitHub issue to a co-pilot and then it starts creating a draft pull request and it outlines the plan and then it works through its plan and you can, simil…”

“I think tomorrow you're going to, as a designer, type effectively the same specification as a product manager and you have, you know, an AI to render the code for the wireframes and then apply, you know, grounding out of your design system to make it look like…”

“And so I think the differentiation is going to come from both, you know, where the developer gets the most The best experience and doing that day to day, right? Like where can I, you know, start my morning, pick up, you know, something I want to work on, explo…”

“I think that future that will happen in the next five years, for sure. It's just the question is how, how good this job is going to be, and can I just tell it, Springbank is coming up, same hotel, same family, you know, say, and it books me the trip, and the …”

“And then we're talking about, you know, 25, 28% productivity gains on, on the end to end 55% or higher on, on the coding task.”

“I think it's going to be compute based or some unit that's, you know, a derivative of, Compute as a metric.”

“I think the model was able, when, with multiple attempts to solve more than 90% of these coding exercises, of these two and 30 coding exercises.”

“Most developers have adopted some form of AI tooling into the workflow already, while other knowledge workers, other white collar workers are still early in that adoption journey.”

“Many of these AI code generation companies that compete with GitHub Copilot are running their inference on Azure AI Foundry.”

“In AI, I think we're going to see the same thing. We're going to see a stack or universe of companies that offer different parts of the software development life cycle, and developers pick the one that you know, they like the most, that they have experience wi…”

“I think we're going to see deflation of software prices. And so I think it's a mix of both, you know, some things we won't pay for it anymore.”

“I think there's going to be a next programming language after Python and TypeScript and Rust and Rust in itself, you know wasn't really a thing five years ago. And then, so there's going to be more languages that are probably closer to human language and to be…”

“We announced last July so almost a year ago that GitHub had passed two billion in, in annual revenue run rate ARR.”

“You can go back in time, 2017, a year before the deal, then GitHub leadership team had announced two hundred million. In AR. So those are not exactly snapping to the timing of the deal, but you get an idea between 2017 and 20 24 revenue when 10 X, right?”

“And so this continuous spectrum of, I can assign tasks, test generation, bug fixes, you know, security vulnerabilities bootstrapping a new feature to the coding agent to, I can take that code base into my local IDE, or I can keep working just as I'm used to al…”

“As the models get better in reasoning we're going to get closer to a hundred percent of this VBench, which is that benchmark out of 12 repos open source Python repos a team in Princeton identified 2200 or so issue pull request pairs. Effectively, all the model…”

“But if you actually look in the developer life the day to day, you know, in, in, in most companies that's maybe two or three hours of your day that you're actually writing code. And then you're spending an equal amount of time of reviewing code of your coworke…”

“And so we are still I think for like a decade or so at least going to have software developers that work in, in lots of old school, you know, PHP code and COBOL code and all that stuff.”

“And then we got this model that then eventually became Codex which was this code-specific, you know, version of the model. And today that, you know No longer really exists, right? Like today, everybody sits on top of one of these more powerful base models.”

“As these AI models get better, these competitions of who's the best hacker or coder Are going to have to move to a whole different level where you assume that the developer is using AI to solve the challenges because otherwise it's going to be way too easy.”

“Back, back in 2018 being Visual Studio, you know, in itself the IDE, you know, the old school IDE in itself, a billion dollar business”

“From a business perspective, that meant the GitHub revenue became part of the Azure KPI that is reported, you know, in, in earnings calls every quarter from Microsoft.”

“And so Copilot does that autocompletion that continues to be the most used features because it is always there.”

“I think Microsoft all up has about 70,000 people in research and development. Not all of them are engineers, there's some product managers and designers, but the majority are writing code.”

“And so in Python, I think the big best benchmarks is 60 to 70%, depending what model agent combination you take. But if you look at multilingual, we are in the 20 to 30% range for these benchmarks.”

“We actually, you know, when we recorded the demo for the Padawan project we actually had one of our product managers use an issue and the agent create the progress themselves. Right. A PM that usually doesn't code and doesn't write code in the code base was ab…”

“Soon after we launched Copilot Preview it already wrote like, 25% of the code.”

“I think the last number we shared was a few quarters ago, 77,000 organizations using Copilot and back then the number of paid users was 1.8 million paid users.”

“VS Code, the editor, was already on GitHub, and in fact, one of the biggest projects on GitHub in terms of number of contributions.”