The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 132 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 1 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Skates: OpenAI's Sam Altman is the best salesperson of this generation
“I think Sam Altman is the best salesperson of this generation by no bar none.”
Tan: OpenAI's GPT Store was a failed experiment
“Like, you saw that with the GPT store at OpenAI a little bit, but I think that was a little bit of a failed experiment.”
Masad: The AI ecosystem will be driven by multiple specialized expert agents
“I think multiple agents. And the reason I think that's true is because let's, let's say I'm someone with true, unique, Domain expertise. Let's say I'm a lawyer who is top in the world at solving certain cases that, that are very rare. And so I have this domain…”
Srinivas: ChatGPT's dominance prompted Perplexity to pivot to building a browser
“ChatGPT is the most successful consumer AI product out there, and so competing against it is very difficult, which is why I really want to, like, push the company more on the browser side, and I think Comet, the browser, will be an abstraction layer about chat…”
Chollet: Fine-Tuned OpenAI o3 Reached Human-Level Performance on ARC
“So in particular, in December last year, OpenAI previewed its, ah, all three model, and they used a version of it that was, ah, fine-tuned specifically on Arc, and that showed human-level performance on that benchmark versus time.”
Altman predicts AI will shift from turn-based chat to proactive persistent companions
“You will have this, like, entity that gets to know you, that connects to all your stuff, and that is, like, proactively helping you. It'll, it won't just be like you send a message and it sends you one back, but it'll, like, be running all the time. It'll be l…”
Altman: OpenAI is focused on making ChatGPT the best super-assistant
“We are going to try to make the best super assistant out of ChatGPT that we can. We're going to Add the things that we think we need to add to that but that is, like, one small part of the opportunity in front of us, and it makes us sad when people are like, I…”
Altman: OpenAI had no defensibility strategy for ChatGPT in its early days
“It took us a long time to figure out how to answer the defensibility question for ChatGPT. We had built this thing, and for a long time, the only defensibility was, like, we had the only product out in the market. And then we kind of, like, a brand that starte…”
Altman: GPT-5 will lack complete reasoning and real-time video integration
“We won't get all the way here with GPT-V, but eventually we do want one integrated model that can, like, reason really hard when it needs to and generate, like, real-time video when it needs to do that.”
Altman: OpenAI's open-source model will run locally and surprise people
“I think it will be, like, much better than you're hoping for, and the ability to, like, use it to run incredibly powerful models locally is gonna, like, really, really surprise people on what's possible.”
Truell: ChatGPT supposedly cost only 1% more to train than GPT-3
“But it rumored that to go from GPT-III, which, you know, had existed for a while and didn't You know, impressed some people, but was certainly not the breakout moment ChatGPT was. To ChatGPT, it was like a one percent increase in the training costs.”
Taggar: o3 follows rubrics rigidly while Gemini 2.5 Pro reasons flexibly
“Oh, three was very rigid, actually. Like it really sticks to the rubric. It's heavily penalizes for anything that doesn't fit like the rubric that you've given it. Whereas Gemini 2.5 pro was actually quite good at being flexible in that it would apply the rubr…”
Blomfield: Google lost its transformer lead to OpenAI through excessive caution
“And so, I think, like, Google were really on the cutting edge of this transformer technology, and were like, leapfrogged by OpenAI, just because I was too cautious to put stuff out there.”
Hu: OpenAI reasoning models are catching up to Claude 3.5 Sonnet
“The thing about CodeGen, the big game in town that we saw, ah, six months ago was Clawed Sonnet. It's still actually a big contender. Most are still using it. But O-one, O-one Pro, and O-three meaning all these resilient models are starting to see it's almost …”
Hu: GPT-4o sees virtually zero use for code generation among founders
“The other one is four-oh, virtually no use for CodeGen.”
McGrew: OpenAI succeeded by balancing startup agility with opinionated scaling bets
“And we took a different approach, which was really more like a startup where there was no sort of big centralized plan. But at the same time, people didn't have, you know, it wasn't just sort of let a thousand flowers bloom. Instead we had opinions about what …”
McGrew: Solving Dota 2 proved scale enables AI generalization
“And there was real insight that was generated there, which was that it really strengthened our belief that scale was the path to improving artificial intelligence. That with Dota two, the secret idea was that we could take huge amounts of experience and feed i…”
McGrew: Ilya Sutskever was the guiding light shaping early OpenAI research
“Early on there were sort of, you know, a couple big projects, as I said, and then some room for exploratory research. And at the very earliest days, the exploratory research was really about you know, it's about what the researcher wanted to do, but also it wa…”
Friedman: Sam Altman Says OpenAI o2 and o3 Are Not Far Behind
“Sam was just telling us that like O-two and O-three are not far behind.”
Altman: OpenAI openly targeted AGI when the field considered it taboo
“We said from the very beginning we were going to go after AGI at a time when in the field you weren't allowed to say that because that just seemed impossibly crazy and, you know, borderline irresponsible to talk about.”
Altman: I wrote OpenAI's early checks before Elon Musk funded scale
“It was definitely helpful that I could just, like, write the early checks for OpenAI, and I think it would have been hard to get somebody else to do that at the very beginning. And then Elon did it a lot at a much higher scale, which I'm very grateful for, and…”
Taggar: 15% of the YC batch adopted OpenAI's o1 before public release
“It seems like, or, 15% of the batch are already using O-one, even though it's not, like, fully available yet.”
Tan: OpenAI enabled internal model distillation as a developer lock-in strategy
“OpenAI itself has now enabled distillation internal to its own API. So you can use O-one, you can use even GPT-IV or IV-O to distill it down into a much cheaper model that's internal to them, like GPT-IV, IV-O-Mini. And that's sort of their, you know, lock-in …”
Blomfield: AI startups relying on OpenAI credits face severe margin shocks
“Just because you're getting free credits doesn't mean that that's a cost that doesn't exist. It just means you're hiding it for the moment. So companies that hide behind OpenAI credits and claim that they've got these huge, huge gross margins have a nasty shoc…”
Habib: Skeptical feedback data gives general model creators an insurmountable flywheel
“There's some question about, you know, whether or not the feedback data might give them a flywheel. I'm a little bit skeptical of that, that it would give them so much that no one could catch up.”
Altman: Research strategy should back intuition, then double down on what works
“Like, try lots of things, let people follow their intuitions, and then when something starts working, put a lot more resources behind it. That's worked for us really well.”
Sidor: OpenAI sacrifices code modularity for brevity to reduce bugs
“We sometimes actually kind of sacrifice good engineering habits, good, good kind of code modularity to make our code shorter and simpler and kind of having less, essentially less lines where you can make bugs.”
Sidor: OpenAI's RL bot beat its hand-coded bot after one to two weeks
“So I leave, there is nothing, I come back, there is this reinforcement learning bot, and actually, it's beating our scripted bot after, like a week worth of engineering effort. Possibly it was two weeks, but it was something very miniature compared to the deve…”
Brockman: ML projects require tracking experiment inputs over outcome milestones
“Initially the way that the project management was happening was that each week, well, so we'd written down our milestones of let's beat this person by this state, let's beat this other person by this state, let's, you know, be able to do, you know, kind of the…”
OpenAI Dota bot learned baiting behavior without explicit reward incentives
“It was like one of the major examples, one of the major examples of the things that we kind of didn't have explicit incentive for, and yet the bot actually learned them.”
Zaremba: OpenAI has secured $1 billion in total investment
“In total we gather an investment of one billion dollar in the group.”
Musk in 2016: OpenAI is structured as a 501(c)(3) nonprofit
“OpenAI is structured as see a five one C three nonprofit but, you know, many nonprofits do not have a sense of urgency.”
Frontier labs achieve recursive self-improvement by retraining models at each step
“And, you know, of course, Anthropic and OpenAI and Google, they're exploring recursive self-improvement, but Typically at that level of having the, you know, having to train a new model for every step of self-improvement that they do.”
French-Owen: Future coding will feel like delegating tasks to coworkers
“Hey, in the future coding is really going to feel more like talking to a coworker. Like you're going to send off a question and then they'll go off and do something and come back to you with a PR.”
French-Owen: OpenAI used reinforcement learning on o3 checkpoints for coding tasks
“Well, basically we kind of had like a checkpoint. For I think it was O three, like one of the reasoning models. And then we did a bunch of fine tuning on it and reinforcement learning where it's like, oh, you're given a bunch of questions to like solve these c…”
French-Owen: Cursor BugBot and Codex perform very well at code review correctness
“I use the cursor bug bot has gotten quite good and I actually like codex for code review as well. I find it does a very good job on correctness.”
French-Owen: OpenAI Codex performs particularly well on Python monorepos
“Codex works very well on Python mono repos.”
Friedman: AI startups act as FDEs translating OpenAI research into adoption
“It's almost like open AI. Is the home product team and the startups are the FTEs out figuring out how to get adoption of the like research that OpenAI is cooking up back at the home office.”
Truell: OpenAI's Original Codex Model Cost Around $100,000 to Train
“By our calculations, Codex, which was the first, this was the first autocomplete model behind GitHub Copilot, it didn't really cost that much money to train, even though, even back then, at kind of the beginning and middle of 2022, people were talking about ho…”
Altman: Unique Missions Give Startups a Strong Tailwind in Recruiting Top Talent
“If you are doing the same thing as everyone else, it is very hard to concentrate talent, and it's very hard to get people to, like, really believe in a mission, and if you're doing, like, a one-of-one thing you have a really nice tailwind there.”
Altman: OpenAI's o3 model cost dropped by 5x in one week
“And also, like last week, O-three cost five times as much as it did this week, and that's gonna keep going.”
OpenAI built a slow, internal web browsing prototype called Truthbot
“OpenAI even had a bot when I worked there called the Truthbot, which John, John built with this team. Where you could ask it a question and it'll go and search the web, and then it'll give you an answer with some sources. And it was very slow, and it was built…”
McGrew: Frontier labs will increasingly rely on model distillation for smaller models
“I think over the last year, the big frontier labs and a lot of other people have figured out the tricks to take big models. And, you know, take a very particular distribution of user input and train a model that is almost as good as the big model, but much, mu…”
McGrew: OpenAI authored early robotics paper as 'OpenAI' to avoid credit disputes
“And one of the early robotics papers, we actually said site as open AI because we didn't want to get into a fight. You know, the first author is the one who, you know, gets cited and their name shows up every single time. So we said, you know, we're not going …”
Friedman: Altman founded OpenAI believing AGI would accelerate all scientific progress
“I remember back when he was starting open AI, one of the things that really motivated him to do it was he believed that when we actually had AGI basically be better at doing science than humans were, and therefore would accelerate the rate of all scientific pr…”