Specialized Model

“I buy it. I think it's also self-serving towards Mercore, in that we think that every specialized model will need enterprise specific eval and training data to show the model how it's performing in its setting, and I think it depends on I think the diversity a…”

“There's areas in which specialized models can actually outperform those big models and not only outperform on kind of the quality or on the performance on this particular task, but also in this kind of triangle of performance, quality latency, speed, and price…”

“Therefore to a large extent in, in businesses, in, in real life applications, you're gonna see kind of the teams that are setting up the infrastructure Really rely also on those specialized models.”

“So I think it's going to be limited to those most important ones, but those most important ones definitely are going to run into this direction to not only Just make sure that the accuracy and the speed are what they are, but also to cover like all of the edge…”

“I mean, I think general models will win out over specialized ones in most cases.”

“I do think we're going to end up in a situation where the most capable model in a domain is going to be a specialized model.”

“Our thesis has always been that, like, you don't, that's not gonna matter. Like, it's just, none of those things will matter the moment you have a model that can learn how to do all of those things at once.”

“We are generally able to, after we do that, take those learnings and basically put that capability into a general model. So there's not that much benefit. You know, you could, you can get away with a somewhat smaller specialized model, a little bit faster, a l…”

“Yeah, I think I am more willing to bet that the specialized models will kind of prove out in the sort of, call it three year timeline than I did before. Just because I think the big models, the big generic models are apparently, and this is again a bit of rumo…”

“You really, I think you're best off with a specialized model trained on the data that's very relevant to the thing, the task you want to solve. Your second best bet is to start with a foundation model that understands the broad space and fine tune it. Again, o…”

“I am absolutely positive that the inverse is also true. That you can find older, smaller, specialized models, ah, that, ah, will, ah, will offer much better, higher quality, lower hallucination results on specific tasks at the depth that most organizations nee…”

“There are going to be these base models. They're probably going to be increasingly open source. And then the reality of what actually ships in production is going to be a whole kind of family tree of smaller specialized models that are tuned and adapted via da…”

“I think where there might be more of a need for specialized models Is when it comes down to kind of higher stakes workflows, and I think that might look in the short term more like a physician's assistant. And so imagine, for example, an agent that can work wi…”