Image-Text-to-Text
Transformers
llava_llama
text-generation
File size: 1,225 Bytes
8b0da89
 
 
 
 
 
db777f1
 
 
 
02f2273
db777f1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69d9a6b
8174539
 
69d9a6b
8174539
db777f1
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
---
license: apache-2.0
datasets:
- liuhaotian/LLaVA-CC3M-Pretrain-595K
library_name: transformers
pipeline_tag: image-text-to-text
---

# Model Card: LLaVA_MORE-llama_3_1-8B-pretrain

```LLaVA-MORE``` enhances the well-known LLaVA architecture by integrating the use of LLaMA 3.1 as the language model. We are publicly releasing the checkpoints for stages one and two for the first model with 8B parameters.

In this model space, you will find the stage one (pretrain) weights of LLaVA-MORE LLaMA 3.1 8B.

For more information, visit our [LLaVA-MORE](https://github.com/aimagelab/LLaVA-MORE) repository.

## Inference
You can try our LLaVA-MORE in the Image-To-Text task by cloning our repository and running the following script.

```bash
python -u llava/eval/run_llava.py
```

## Citation
If you make use of our work, please cite our repo:

```bibtex
@article{cocchi2025llava,
      title={{LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning}},
      author={Cocchi, Federico and Moratelli, Nicholas and Caffagni, Davide and Sarto, Sara and Baraldi, Lorenzo and Cornia, Marcella and Cucchiara, Rita},
      journal={arXiv preprint arXiv:2503.15621},
      year={2025}
}
```