Moondream

“I think the thing that's really exciting about this is it makes it possible for developers to build using the two B per model and Just explore, build their application, and then once they're ready to deploy, figure out what exactly they need out of the model a…”

“The way we built our model was to start with the two billion parameter model and Prune it while doing continual training to retain performance.”

“The real question is, is it going to generalize? Probably, like, there's some signs from text models that when you train on a broad number of tasks, it does generalize, and I'm seeing some signs with our model as well.”