Opinion
OpenAI models remain the industry best for chained function calling
“And so we find like the open AI models function calling wise for our use case. So for the best ones and like, yeah, basically verifying the others. We had a beta group and testing different models. So basically from all providers and yeah, find basically the b…”
Opinion
Mann: AI evaluations for tool calling are super unsolved across industry
“Nobody talks about how to do evals with tool calls. It's, like, a super unsolved thing.”
Opinion
Raycast CEO: Incumbent operating systems are too mature to innovate
“But I can't really see that coming from the big operating systems. They're like so mature. They're like nothing moves anymore.”
Disclosure
Raycast built its Ray 1 models by fine-tuning GPT-4o and mini
“And so we looked into all the various models we had and then we picked, at the moment, it's gbd-for-o and gbd-for-o-mini, Which we basically did a fine tune to really optimize for our use case, and then basically shipping that in the app as Ray one and Ray one…”
Insight
Mann: OpenAI-Compatible APIs Still Have Subtle Behavioral Differences
“Like, even though all models say they support open AI compatible APIs, they're always in nuances which are slightly different and then put you off when you see it for the first time.”
Disclosure
Raycast is expanding to Windows and iOS as an AI-native OS layer
“Like our future is basically turning Mac OS and we also now expanding the windows and iOS and really like a AI native operating system.”
Disclosure
Raycast announces AI extensions allowing developers to extend Raycast AI
“So tomorrow we're going to release our next big feature, which is called AI extensions. And that basically brings together our roots of like having developers extending Raycost. And this time they can extend Raycost AI.”
Assertion Supported
Mann: Raycast AI Extensions operate via OAuth and APIs, not computer use
“So this is primarily like using like OAuth and then doing API calls and then developers basically can expose those information to our AI and then we're picking it up and composing those information together.”
Assertion Supported
OpenAI API throws errors when users exceed a 128-tool limit
“Which OpenAI would be figured out at some point is, like, oh, there is an upper limit of, like, a 128 Tools you can have. And then the API basically gives you an error. So we ran into some of those issues as well.”
Disclosure
Mann: Raycast Built Its AI Model Router Internally
“And we're not using, like, a proxy, like a router or something like this, so we built that internally.”
Disclosure
Raycast built a DSL for third-party developers to run AI extension evals
“So we basically came up with a system that they can write like a DSL for those evals, and then they can run the evals themselves.”
Disclosure
Mann: Raycast extracts LLM tool definitions directly from TypeScript JSDoc
“Basically what we came up with, it's essentially you just write a TypeScript function and you document your TypeScript function with JSDoc. And then we extract all the information from there and basically make that and pass that information to the LLMs.”
Disclosure
Mann: All Raycast AI extensions will be open source, launching with 50
“So all of those AI extensions going to be open source. We have 50 at the beginning.”
