The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 11 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
OpenAI models remain the industry best for chained function calling
“And so we find like the open AI models function calling wise for our use case. So for the best ones and like, yeah, basically verifying the others. We had a beta group and testing different models. So basically from all providers and yeah, find basically the b…”
Mann: AI evaluations for tool calling are super unsolved across industry
“Nobody talks about how to do evals with tool calls. It's, like, a super unsolved thing.”
Raycast built its Ray 1 models by fine-tuning GPT-4o and mini
“And so we looked into all the various models we had and then we picked, at the moment, it's gbd-for-o and gbd-for-o-mini, Which we basically did a fine tune to really optimize for our use case, and then basically shipping that in the app as Ray one and Ray one…”
Raycast is expanding to Windows and iOS as an AI-native OS layer
“Like our future is basically turning Mac OS and we also now expanding the windows and iOS and really like a AI native operating system.”
Mann: Raycast extracts LLM tool definitions directly from TypeScript JSDoc
“Basically what we came up with, it's essentially you just write a TypeScript function and you document your TypeScript function with JSDoc. And then we extract all the information from there and basically make that and pass that information to the LLMs.”
Raycast built a DSL for third-party developers to run AI extension evals
“So we basically came up with a system that they can write like a DSL for those evals, and then they can run the evals themselves.”
Mann: Raycast Built Its AI Model Router Internally
“And we're not using, like, a proxy, like a router or something like this, so we built that internally.”
Mann: All Raycast AI extensions will be open source, launching with 50
“So all of those AI extensions going to be open source. We have 50 at the beginning.”
OpenAI API throws errors when users exceed a 128-tool limit
“Which OpenAI would be figured out at some point is, like, oh, there is an upper limit of, like, a 128 Tools you can have. And then the API basically gives you an error. So we ran into some of those issues as well.”