metadata
license: apache-2.0
language:
- en
metrics:
- accuracy
library_name: transformers
pipeline_tag: video-text-to-text
tags:
- multimodal large language model
- large video-language model
base_model:
- DAMO-NLP-SG/VideoLLaMA3-2B-Image
PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularity
📰 News
- [2025.10.28] 🔥We release PixelRefer.
- [2025.6.19] 🔥We release the demo of VideoRefer-VideoLLaMA3, hosted on HuggingFace. Feel free to try it!
- [2025.6.18] 🔥We release a new version of VideoRefer(VideoRefer-VideoLLaMA3-7B and VideoRefer-VideoLLaMA3-2B), which are trained based on VideoLLaMA3.
- [2025.4.22] 🔥Our VideoRefer-Bench has been adopted in Describe Anything Model (NVIDIA & UC Berkeley).
- [2025.2.27] 🔥VideoRefer Suite has been accepted to CVPR2025!
- [2025.2.18] 🔥We release the VideoRefer-700K dataset on HuggingFace.
- [2025.1.1] 🔥We release VideoRefer-7B, the code of VideoRefer and the VideoRefer-Bench.
🌏 Model Zoo
| Model Name | Visual Encoder | Language Decoder |
|---|---|---|
| PixelRefer-7B | VL3-SigLIP-NaViT | Qwen2.5-7B-Instruct |
| PixelRefer-2B | VL3-SigLIP-NaViT | Qwen2.5-1.5B-Instruct |
| PixelRefer-Lite-7B | VL3-SigLIP-NaViT | Qwen2.5-7B-Instruct |
| PixelRefer-Lite-2B | VL3-SigLIP-NaViT | Qwen2.5-1.5B-Instruct |
📑 Citation
If you find VideoRefer Suite useful for your research and applications, please cite using this BibTeX:
@article{yuan2025pixelrefer,
title = {PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularity},
author = {Yuqian Yuan and Wenqiao Zhang and Xin Li and Shihao Wang and Kehan Li and Wentong Li and Jun Xiao and Lei Zhang and Beng Chin Ooi},
year = {2025},
journal = {arXiv},
}
@inproceedings{yuan2025videorefer,
title = {Videorefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM},
author = {Yuqian Yuan and Hang Zhang and Wentong Li and Zesen Cheng and Boqiang Zhang and Long Li and Xin Li and Deli Zhao and Wenqiao Zhang and Yueting Zhuang and others},
booktitle = {Proceedings of the Computer Vision and Pattern Recognition Conference},
pages = {18970--18980},
year = {2025},
}