The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 16 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Ramachandran: SWE-bench and HumanEval do not reflect real professional software engineering
“Most evals and benchmarks that exist out there for software development is kind of bogus. There's not really a better way of putting it. Like, okay, you have SweeBench, that's cool, no actual Professional work looks like Sweebench, like human eval, same thing.”
Ramachandran: SWE-bench and HumanEval do not reflect real professional engineering
“Most evals and benchmarks that exist out there for software development is kind of bogus. There's not really a better way of putting it. Like, okay, you have sweet bench. That's cool. No actual Professional work looks like Sweebench. Like, human eval, same thi…”
Ramachandran: AI flows will succeed AI agents in developer tooling
“Copilots are collaborative, but can only work on small scopes. Agents can do larger tasks, but are not collaborative. Both are very useful, but we realize that this real magic will happen when the AI has the ability to be both collaborative and independently p…”
Ramachandran: Cascade goes further than any other agentic system
“This allows Cascade to be independent, but Cascade takes it further than any other agentic system. By also generating commands to be run.”
Ramachandran: Tracking developer trajectory allows AI to infer intent without prompting
“If we're actually being able to understand the kind of the trajectory of what developers are doing within the editor, right, if we actually are being able to see, like, oh, the developer just went and opened up this part of the directory and tried to view it, …”
Ramachandran: Capturing Editor Trajectories Lets AI Infer Intent Without Explicit Prompting
“If we actually understand that trajectory, then our ability for the AI to just be immediately be like, Oh, I understand your intent. This is what you want to do without you having to spell it all out for it. That is one like that kind of like magic would reall…”
Ramachandran: Coding agents needing constant human fixes are unready for autonomy
“If the agent there has to always get human involvement to keep on fixing itself, it's probably not ready to become a full end-to-end automated system, because then we're just going to turn into a linter where, like, it produces a bunch of things and no one loo…”
Ramachandran: Executing terminal commands in Cascade will be a huge unlock
“Vern's talked about not just suggesting the terminal command, but actually executing them. Like, I think that's gonna be a huge unlock.”
Ramachandran: Codeium grew from zero to $10M ARR in under a year
“I don't think we go from zero to ten million ARR in less than a year in an enterprise product if we don't have a product that developers love.”
Ramachandran: Needle-in-a-haystack retrieval benchmarks fail to model real code retrieval
“A lot of the benchmarks for these embedding-based systems are like needle in the haystack problems. Like, I want to find this one particular piece of information out of all this potential context. That's not That's not really what actually is necessary for doi…”
Ramachandran: Premature end-to-end AI automation reduces agents to ignored linters
“If the agent there has to always get human involvement to keep on fixing itself, it's probably not ready to become a full end-to-end automated system, because then we're just going to turn into a linter where, like, it produces a bunch of things and no one loo…”
Ramachandran: Autonomous terminal command execution will be a huge unlock
“I mean, of course, I mean, Vern's talked about not just suggesting the terminal command, but actually executing them. Like, I think that's gonna be a huge unlock.”
Ramachandran: Codeium is the only AI code assistant supporting Eclipse
“Like, we're still the only code assistant that has an extension of Eclipse. That's still true years in, right?”
Ramachandran: Codeium reached $10M enterprise ARR in under a year
“Like I don't think we go from zero to ten million ARR in less than a year in an enterprise product if we don't have a product that developers love.”
Ramachandran: Codeium's $10/month plan primarily covers compute costs without high margins
“And so we just created a 10 dollar a month pro plan, mostly just to cover the cost. Like we're not really like operating, I think, on a much of a margin there either, but like, okay, like just to cover us there.”