The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 12 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Heller: Casetext built CoCounsel with plain Python, dismissing frameworks like LangChain
“And to be honest, a lot of the stuff that we built while building co-council was exactly like this. Every time you do this task, you're basically gonna take the same six or seven steps. And you don't need to have, frankly, like fucking Langchain or whatever. J…”
Tan: AI startup moats come from proprietary data for domain evals
“You can almost Argue that anything that is consumer and publicly available on the internet, that's going to be in the base model. So then your moat ultimately is for all of the other things that are not already online, whether it's, you know, for case techs be…”
Heller: GPT technology is underhyped because GPT-4 operates at postgraduate level
“So this is gonna sound probably insane to most people who hear it, but I think the GPT technology is under hyped because what we see in GPT-IV specifically as a model, and I'm assuming the same will be true as new models come out in the state of the art advanc…”
Heller: Targeting legal tech pre-LLMs was a mistake due to low software spend
“I actually feel like in some ways for us in the early days focusing on legal, Made sense for us because I knew legal, but also it's kind of a mistake because at the time the legal software industry Pre-LLMs is actually pretty small because it was like a fracti…”
Heller: Casetext pivoted with $20M revenue and 100 employees for GPT-4
“We were like twenty million dollars in revenue. We were doing great. I had like a hundred people and we stopped everything that we were doing and said, we're going to build something totally new based on this new technology.”
Heller: Casetext poised to triple annual revenue after CoCounsel launch
“I mean, we were almost certainly going to triple our revenue in the course of this year, and that's after 10 years of building the revenue we had before, right?”
Heller: Casetext derived most evals from customer failures, not lab tests
“We've added much more evals at this point from real things that happened to real customers than the ones we came up with in the lab.”
Heller: Enterprise customers preferred predictable $6,000 annual seats over usage pricing
“When we asked our customers, they said, listen, I'd rather pay more, but make it like consistent throughout the year, then potentially pay less and pay per use. So our customers wanted to pay a 6000 dollars per seat. They want to proceed and they want to pay 6…”
Heller: 30% to 40% of Casetext Employees, Including Coders, Were Lawyers
“It was helpful for us that, that I was a lawyer, my co-founders were lawyers, 30 to 40% of my company, even the coders were lawyers, because we actually lived it.”
Heller: Casetext received early access to GPT-4 in summer 2022
“Because we were so focused on large language models and were researching deeply in this space, we got really early access to GPT-IV. Like summer, 20, 22.”