Braintrust

“First of all a vast majority of our customers use TypeScript and, you know, early on, some of our customers were dealing with, like, should we use TypeScript or Python? And some teams were using TypeScript, some teams were using Python. Now, almost everyone, i…”

“The biggest thing I've seen over the past six months is, People dropping the use of frameworks.”

“Probably the most consistent thing I've seen is companies kind of walking back from the illusion that totally free form agents will solve all of their problems. So I think maybe like two or three months ago, Many of the pioneering companies went way down the a…”

“So we see very limited practical adoption of open source models, but I think more interest than ever.”

“I think probably more than half of the evals that people do in Braintrust are LLM based.”

“I remember in the early conversations we had around the company or the idea, I should say, it was meant to even potentially be open source. And as the first time that I was involved with some sort of customer call and people would say, we don't want you to ope…”

“Actually, for example, if you do a front-end interview at Braintrust, one of the questions involves writing some C++, and we lose a lot of candidates because of that question but it's a good signal that maybe Braintrust isn't the right place for you to work.”

“Really the thing that we did was we made that list of, like, 50 people who we thought were leading the way in AI and said, you know, let's try to figure out a way to get to these people and either get, recruit them as investors or as customers. And I think tha…”

“Unambiguously, people are doing rag. So that one is, you know, it's like simple and obvious. Probably around 50% of the use cases that we see in production involve rag of some sort.”

“Almost if not all of our customers have moved off of fine-tuned models onto instruction-tuned models and are seeing really good performance.”

“Another thing that we're really bullish on at Braintrust is people being in the office and being really comfortable being interrupt-driven.”

“There's some companies that we talked to and their AI vendors are, it's literally OpenAI, AWS, and Braintrust and pretty much everything else has consolidated away.”

“I angel invested in a lot of the companies you just listed. A lot of their founders are angel investors in our company.”