Installation
Clone the repository and navigate to the RRPO directory:
git clone https://github.com/pritamqu/RRPO
cd RRPO
conda create -n llava python=3.10 -y
conda activate llava
pip install -r llavavideo.txt
Download weights
# base model
git clone [email protected]:lmms-lab/LLaVA-Video-7B-Qwen2
# RRPO weights
git clone [email protected]:pritamqu/LLaVA-Video-7B-Qwen2-RRPO-32f-LORA
Inference
conda activate llava
BASE_WEIGHTS="./LLaVA-Video-7B-Qwen2"
WEIGHTS_ROOT="./"
## using lora weights
python inference.py \
--base_model_name "llavavideo_qwen_7b" \
--model-path ${BASE_WEIGHTS} \
--model-path2 ${WEIGHTS_ROOT}"/LLaVA-Video-7B-Qwen2-RRPO-32f-LORA" \
--video_path "sample_video.mp4" \
--question "Describe this video." \
--model_max_length 1024
- Downloads last month
- -
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for pritamqu/LLaVA-Video-7B-Qwen2-RRPO-32f-LORA
Base model
lmms-lab/llava-onevision-qwen2-7b-si
Finetuned
lmms-lab/LLaVA-Video-7B-Qwen2