The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 28 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Early AI teams preferred managed evals over brittle open-source tools
“We actually heard early on from people and allergic, no reaction to that. They were like, Hey, we were using open source stuff and it's super brittle and it breaks all the time. And we just evals suck and observability sucks and we just don't want to deal with…”
Braintrust built a terrible go-to-market motion to test product strength
“I wanted at Braintrust to, again, in the spirit of skepticism, Build a terrible go-to-market motion early on, but make the product, make Braintrust only successful if the product was so good that despite being grossly incompetent at selling and marketing our p…”
Overhyped failure is much better for startups than dying in obscurity
“I think there's only one right answer, which is it's much better to be overhyped and then fail. I mean, obviously within the realms of morality and integrity, but I was, I sort of learned like, I don't want to be an obscure product that no one cares about.”
Pre-PMF startups must hire salespeople accustomed to working without PMF
“A classic example of this is when companies hire salespeople from extremely successful product-led companies, and they expect the salesperson to be good for their product-led company that does not have product market fit. That is not the right You actually wan…”
When a product fails to sell, the problem is almost always pipeline
“Like if your product isn't selling for some reason, then it's almost always pipeline.”
Starting a company without an idea prevents finding product-market fit
“And then I did something which I honestly don't think any founder should do. We're talking about product market fit. This is almost a surefire way to prevent yourself from finding product market fit. But I sat down and I said, okay, I want to start a company. …”
Early founders must be ultra-paranoid about customer use-case repeatability
“I think in the world of early product building, you actually need to be like ultra paranoid about repeatability. And you need to assume that, you know, give yourself a little bit of credit and assume that you're somewhat charismatic or Entertaining or whatever…”
Relational databases perform terribly at full-text search workloads
“Understandable, but staggering to me how bad relational databases are at full text search. Just, they're just awful.”
Braintrust operates with only one company-wide meeting per week
“Like, we don't have, we have one meeting per week as a company, and that's it.”
Requiring 40-to-50-person startup teams to work weekends is very challenging
“I think personally, my perspective is even if you're trying to hire like a pretty good, well-rounded and, you know, skilled group of people that's even, you know, 40 or 50 people, it's very challenging to get everyone to work on weekends. And so we don't, that…”
If a startup has to convince users, it lacks product-market fit
“I think if you have to convince people, it's super unlikely that you have product market fit. Whereas if without convincing people, they just find their way to the product and then they've, they're already convinced or they've convinced themselves very quickly…”
Building high-quality software requires assuming new code is broken
“I think you have to pay attention to literally every possible sign that the software is not working. And I think the first step is actually just believing that when you type something or you build a feature, it's not going to work.”
Top AI engineers can intuit the quality curve of new features
“Really good AI people are able to intuit what the quality curve will look like for a new feature.”
Recruiting is an apprenticeship trade best learned from elite recruiters
“I think recruiting is one of those sort of trades that you need to learn by working as an apprentice with someone who's really good at recruiting.”
Raising venture capital does not validate idea quality or product-market fit
“Raising money was no indication of the quality of your idea or product market fit or chances for finding product market fit.”
Sales founders learn markets are uncontrollable earlier than engineering founders
“I think that sales or go-to-market founders often have this intuition earlier than engineering founders do is that markets and what people actually want are in many ways out of your control.”
Intellectually fascinating technical problems efficiently drive peer-to-peer customer acquisition
“I think that people without us having to force them to or ask them to, they are just interested in solving the problem around evals and they find it intellectually fascinating on their own. And I think that leads to a lot of organic knowledge sharing. A lot of…”
Tantivi was the only search library to survive Braintrust's 100x benchmark
“There's one library called Tantivi, which is a Rust re-implementation of the Lucene search index, which is a very popular and well-regarded and used search technology. It's the technology behind Elasticsearch as well. And that was the only piece of code that w…”
Braintrust deliberately excluded traditional enterprises early to focus on product engineers
“We say our product is for product engineering teams that are trying to incorporate AI into their core products and services. And that description excludes and excluded a lot of, ah, sort of traditional enterprises, for example, early on, and we were okay with …”
Goyal cuts off all meetings at noon to protect afternoon focus
“So I cut off meetings at noon every day. I don't take any meetings afternoon.”
Goyal has worked every weekend since joining the MemSQL founding team
“I work every weekend. And I have since I joined MemSQL.”
Taking a product from 95% to 100% quality is exceptionally challenging
“It's pretty easy, and now I would say even like easier to build a prototype, but the craft of actually taking something from 95% to 99% or a hundred percent is very challenging and not something they teach you in school.”
Recruiting elite engineers requires a multi-year, non-transactional process
“Recruiting really, really good engineers is not a transactional process. I think that sounds very obvious to anyone who's tried or read about recruiting, but until you experience it, it's very hard. We sometimes spend years recruiting someone”
Figma is exceptionally good at recruiting talent
“For example, I was at Figma recently, I think they're really exceptional at it.”
Impira reached millions in ARR without repeatable customer use cases
“We had a few million dollars in ARR, but very little repeatability across what they were doing. So when we tried to bring on a sales team and scale that what they were selling and their ability to scale the success from those early users into the end plus firs…”
AI observability logs average 50KB per row compared to 900B traditionally
“Every span in brain trust land, which is like a row of something that you'd log in brain trust, the average size is
50 kilobytes.
In traditional observability, it's 900 bytes.”