AutoResearch

“I, so the stuff I've seen people do with it is nowhere on the architecture level. It's pretty much tweaking parameters, but it's basically a high proprietor sweep that's guided by some sort of model intuition. So it's like much more efficient than whatever oth…”

“Autoresearch is very good at doing kind of obvious things that you don't have bandwidth to do, or you didn't notice, or maybe you're not aware of like some standard practices. It is not good at doing something completely out of distribution, something that, yo…”

“And then I let our research go for like overnight and it came back with like tunings that I didn't see. And yeah, I did forget like the weight decay on the value embeddings and my atom betas were not sufficiently tuned and these things jointly interact.”

“A research organization is a set of markdown files that describe all the roles and how the whole thing connects.”

“This is extremely well suited to anything that has objective metrics that are easy to evaluate. So for example, like writing kernels for more efficient CUDA, you know, code for various parts of a model, etc., are the perfect fit. Because you have inefficient c…”

“Using auto research and a chunk of data, something was published internally that we said, oh my god, and that would normally be a PhD thesis that would take seven years, that would be one of the most celebrated PhD pieces we've ever seen in this field, and it …”

“You need a NVIDIA chip to actually run auto research, or you can do it in the cloud. I'll talk about this at the end of the episode, but you know, you do need that. You can't just run it on, let's say you have a Mac book M one or something like that.”

“Think of, you know, tools like Optimizely. That's a SaaS tool that, you know, when I first moved to San Francisco, I remember how big they were and everyone's talking about Optimizely and, A B testing. And it's like, well, this is the future of that auto resea…”

“So if you already have built a SaaS or workflow, embed an auto research style agent so your users can press optimize, just like a big, I envision like a big button that just says optimize, and the system runs a mini research loop for them. So for example, tune…”

“Because Autoresearch lets you run hundreds of experiments instead of a few, you have a simple pitch. We do a hundred times more testing than other shops for the same or lower fee.”

“It's going to be an unfair advantage for a lot of people. So I think you're going to see a lot more digital products that people sell and also, you know, just using their own money, trading themselves instead of giving one percent or whatever to a financial ad…”

“The GitHub, the auto research GitHub repo. And wow, 25,000 stars already, so this is crazy. It's really growing, growing quick.”