Update README.md (#1)
Browse files- Update README.md (f30020378c57845cf5ba7ed2569a16ab174c78d3)
Co-authored-by: John <[email protected]>
README.md
CHANGED
|
@@ -90,10 +90,10 @@ Note: llava-llama-3-8b-v1_1 uses the Llama-3-instruct chat template.
|
|
| 90 |
|
| 91 |
```bash
|
| 92 |
# fp16
|
| 93 |
-
./llava-cli -m ./llava-llama-3-8b-v1_1-f16.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
| 94 |
|
| 95 |
# int4
|
| 96 |
-
./llava-cli -m ./llava-llama-3-8b-v1_1-int4.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
| 97 |
```
|
| 98 |
|
| 99 |
### Reproduce
|
|
|
|
| 90 |
|
| 91 |
```bash
|
| 92 |
# fp16
|
| 93 |
+
./llava-cli -m ./llava-llama-3-8b-v1_1-f16.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096 -e -p "<|start_header_id|>user<|end_header_id|>\n\n<image>\nDescribe this image<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
|
| 94 |
|
| 95 |
# int4
|
| 96 |
+
./llava-cli -m ./llava-llama-3-8b-v1_1-int4.gguf --mmproj ./llava-llama-3-8b-v1_1-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096 -e -p "<|start_header_id|>user<|end_header_id|>\n\n<image>\nDescribe this image<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
|
| 97 |
```
|
| 98 |
|
| 99 |
### Reproduce
|