Instructor

“And so I just said, let me write, like, the most simple SDK around the OpenAI SDK, sorry, simple wrapper on the SDK, just handle the response model a bit, and kind of think of myself more like requests than an actual framework that people can use.”

“So much of it is changing that if you give control of these systems away too early, you end up ultimately wanting them back. Like many companies I know that I reach out or ones were like, oh, we're going off of the frameworks because now that we know what the …”

“Embeddings really is kind of like the lowest hanging fruit, and using something like Instructor can really help produce a data structure, and then you can just use your computer science to reason about this data structure.”

“But to back to the instructor thing, I just don't think it's a billion dollar company.”

“One of the things we found out about these language models is that not only can you define nodes, it's really good at figuring out what are nodes and what are edges.”

“We use structured outputs for AI news. I use Instructor and I ripped it out and I think it, I saved 20 lines of code, but more importantly, it was like, we cut it by 55% of API costs based on what I measured because of all we saved on the retries.”