PaliGemma

“We took an open source vision language model, a three billion parameter model called polygema. Previously we were using, the previous videos were all with like a hundred to three hundred million parameters that we're iterating on. This model takes as input ima…”

“One of my critiques, I guess, of polygeoma one, at least, is that you find that performance saturates as a pre-trained model after only three hundred million examples seen.”