Abstract: Encoder-free multimodal large language models (MLLMs) eliminate the need for a well-trained vision encoder by directly processing image tokens before the language model. While this approach ...

Abstract: Image encoder pre-training has experienced a substantial evolution due to contrastive learning, facilitating the extraction of intricate feature representations from unlabeled datasets.