ing0 commited on
Commit
fd5a488
Β·
1 Parent(s): cf637e7

add model ckpt

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.png filter=lfs diff=lfs merge=lfs -text
37
+ *.jpeg filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,81 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ - zh
6
+ tags:
7
+ - text-to-speech
8
  ---
9
+
10
+ # MeanVC: Lightweight and Streaming Zero-Shot Voice Conversion via Mean Flows
11
+
12
+ <div align="center">
13
+
14
+ [![Paper](https://img.shields.io/badge/arXiv-2510.08392-b31b1b.svg)](https://arxiv.org/pdf/2510.08392)
15
+ [![Github](https://img.shields.io/badge/Github-Page-green)](https://github.com/ASLP-lab/MeanVC)
16
+ [![Demo Page](https://img.shields.io/badge/Demo-Audio%20Samples-green)](https://aslp-lab.github.io/MeanVC/)
17
+
18
+ </div>
19
+
20
+ **MeanVC** is a lightweight and streaming zero-shot voice conversion system that enables real-time timbre transfer from any source speaker to any target speaker while preserving linguistic content. The system introduces a diffusion transformer with chunk-wise autoregressive denoising strategy and mean flows for efficient single-step inference.
21
+
22
+ ![img](figs/model.png)
23
+
24
+ ## ✨ Key Features
25
+
26
+ - **πŸš€ Streaming Inference**: Real-time voice conversion with chunk-wise processing.
27
+ - **⚑ Single-Step Generation**: Direct mapping from start to endpoint via mean flows for fast generation.
28
+ - **🎯 Zero-Shot Capability**: Convert to any unseen target speaker without re-training.
29
+ - **πŸ’Ύ Lightweight**: Significantly fewer parameters than existing methods.
30
+ - **πŸ”Š High Fidelity**: Superior speech quality and speaker similarity.
31
+
32
+
33
+ ## πŸ’Ύ Model Download
34
+
35
+ Use the following Python script to download the models into a local directory (e.g., ./checkpoints):
36
+
37
+ ```python
38
+ from huggingface_hub import snapshot_download
39
+
40
+ # Download all necessary models and components for MeanVC
41
+ snapshot_download(
42
+ "ASLP-lab/MeanVC",
43
+ allow_patterns=[
44
+ "model_200ms.safetensors", # The trained MeanVC model weights
45
+ "meanvc_200ms.pt", # JIT-compiled model for real-time inference
46
+ "fastu2++.pt", # JIT-compiled ASR model
47
+ "vocos.pt" # JIT-compiled Vocos vocoder
48
+ ],
49
+ local_dir="./checkpoints", # Specify your target directory
50
+ local_dir_use_symlinks=False
51
+ )
52
+ ```
53
+
54
+
55
+
56
+ ## πŸ“œ License & Disclaimer
57
+
58
+ MeanVC is released under the Apache License 2.0. This open-source license allows you to freely use, modify, and distribute the model, as long as you include the appropriate copyright notice and disclaimer.
59
+
60
+ MeanVC is designed for research and legitimate applications in voice conversion technology. Users must obtain proper consent from individuals whose voices are being converted or used as references. We strongly discourage any malicious use including impersonation, fraud, or creating misleading audio content. Users are solely responsible for ensuring their use cases comply with ethical standards and legal requirements.
61
+
62
+ ## πŸ“„ Citation
63
+
64
+ If you find our work helpful, please cite our paper:
65
+
66
+ ```bibtex
67
+ @article{ma2025meanvc,
68
+ title={MeanVC: Lightweight and Streaming Zero-Shot Voice Conversion via Mean Flows},
69
+ author={Ma, Guobin and Yao, Jixun and Ning, Ziqian and Jiang, Yuepeng and Xiong, Lingxin and Xie, Lei and Zhu, Pengcheng},
70
+ journal={arXiv preprint arXiv:2510.08392},
71
+ year={2025}
72
+ }
73
+ ```
74
+
75
+ ## πŸ“§ Contact
76
+
77
+ If you are interested in leaving a message to our research team, feel free to email [email protected]
78
+
79
+ <p align="center">
80
+ <img src="figs/[email protected]" width="500"/>
81
+ </p>
config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "DiT",
3
+ "model": {
4
+ "dim": 512,
5
+ "depth": 4,
6
+ "heads": 2,
7
+ "ff_mult": 2,
8
+ "bn_dim": 256,
9
+ "conv_layers": 4,
10
+ "chunk_size": 20,
11
+ "dropout": 0.0,
12
+ "qk_norm": "rms_norm"
13
+ }
14
+ }
figs/model.png ADDED

Git LFS Details

  • SHA256: 0514278f969b291eceab1c2fa4c4171008ba47688798e9ecaa4c6d3cb9c2b826
  • Pointer size: 131 Bytes
  • Size of remote file: 292 kB
figs/[email protected] ADDED

Git LFS Details

  • SHA256: 41eae6df7b8458e13ffd2de14876f95cd3f7fad91f8527a751a7dd63347c6a71
  • Pointer size: 132 Bytes
  • Size of remote file: 1.56 MB
model_200ms.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c2d9ed6c8c149d4fdf9ba6f17ebbc675784010585344448136261c874decb0f
3
+ size 56271424