Update README.md (#3)
Browse files- Update README.md (2214d5b1c85b33097a870b520631badcd6b18643)
Co-authored-by: Hao Zhang <[email protected]>
README.md
CHANGED
|
@@ -14,7 +14,7 @@ Base LLM: Qwen/Qwen1.5-7B-Chat
|
|
| 14 |
|
| 15 |
### Model Description
|
| 16 |
|
| 17 |
-
**Repository:** https://github.com
|
| 18 |
|
| 19 |
**Primary intended uses:** The primary use of LLaVA-Next Interleave is research on large multimodal models and chatbots. This is only for research exploration, and prohibited for commercial usage.
|
| 20 |
|
|
@@ -28,7 +28,14 @@ This project utilizes certain datasets and checkpoints that are subject to their
|
|
| 28 |
|
| 29 |
Use the code below to get started with the model.
|
| 30 |
|
| 31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
|
| 33 |
|
| 34 |
|
|
@@ -36,4 +43,7 @@ Use the code below to get started with the model.
|
|
| 36 |
|
| 37 |
Use the code below to evaluate the model.
|
| 38 |
|
| 39 |
-
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
### Model Description
|
| 16 |
|
| 17 |
+
**Repository:** https://github.com/LLaVA-VL/LLaVA-NeXT
|
| 18 |
|
| 19 |
**Primary intended uses:** The primary use of LLaVA-Next Interleave is research on large multimodal models and chatbots. This is only for research exploration, and prohibited for commercial usage.
|
| 20 |
|
|
|
|
| 28 |
|
| 29 |
Use the code below to get started with the model.
|
| 30 |
|
| 31 |
+
```bash
|
| 32 |
+
git clone https://github.com/LLaVA-VL/LLaVA-NeXT
|
| 33 |
+
# install llava-next
|
| 34 |
+
...
|
| 35 |
+
# download the ckpt
|
| 36 |
+
...
|
| 37 |
+
bash playground/demo/interleave_demo.py --model_path path/to/ckpt
|
| 38 |
+
```
|
| 39 |
|
| 40 |
|
| 41 |
|
|
|
|
| 43 |
|
| 44 |
Use the code below to evaluate the model.
|
| 45 |
|
| 46 |
+
Please first edit /path/to/ckpt to the path of checkpoint, /path/to/images to the path of "interleave_data" in scripts/interleave/eval_all.sh and then run
|
| 47 |
+
```bash
|
| 48 |
+
bash scripts/interleave/eval_all.sh
|
| 49 |
+
```
|