Everything Howard Katzenberg said on any show that made the record, most notable first. Each card names its show and opens the statement there.
LLM migration eliminated annotation teams and increased Glean AI's gross margins
“The accuracy rates are better. Our cost to compute has gone down and like, it is the data scientist. We don't need a team to do annotations anymore for the models. And it's just like, it's like our gross margins. It's done like two step functions over the cour…”
Katzenberg: 99 out of 100 vendor bills were approved automatically at Better
“And when I actually analyzed what our approval rate was at Better, 99 out of a hundred bills were getting approved.”
Katzenberg: Commercial LLMs do not provide extraction confidence scores
“One of the drawbacks of using LLMs is like, we're not receiving confidence scores. On the extractions.”
Katzenberg: LLMs are very poor at performing calculations
“We're going to do the calculations because the LLMs are very poor at that.”
Katzenberg: Glean AI business grew over 3x in 2023
“Our business is up like three X, over three X so far this year.”
Katzenberg: External AI model pricing will fall over 12-18 months
“I think their pricing will continue to improve. So we can't just look at like where their pricing is today and assume it's going to be static over the next 12 months or 18 months. Cause like as they compete, their compute costs will come down. Like they'll, I …”
Katzenberg: Manual vendor spend audits consistently yielded about 10% savings
“Inevitably, we'd find errors, we'd find consolidation opportunities, we'd play bad guy negotiations, but we'd find about 10% of savings opportunities each time we conducted this exercise.”
Better identified $1.5M in savings on $15M of annual vendor spend
“The last time we did it was in 2019 and, at Better, the run rate on vendor spend at the time was about fifteen million dollars annually. And we've identified 1.5 million of savings.”
Glean AI shifted 100% of its machine learning stack to LLMs
“Over the course of the last 12 to 18 months, we've done a hundred percent shift to LLM modeling for the complete stack. And we're using Vertex and OpenAI.”
League Apps saved $20,000 on Salesforce contract using Glean AI benchmarking data
“So we gave him benchmarking data and he reported back that they saved 20 K versus their prior contract.”
League Apps estimates Glean AI saves 2-3% of non-payroll spend
“And then he also said like, he estimates that Glean, like the value is like two to three percent of non-payroll spend.”