---
base_model:
- aoi-ot/VibeVoice-Large
tags:
- text-to-speech
- tts
- lora
- sft
- full-finetune
- vibevoice
language:
- hu
---
# VibeVoice_7B_Hun_v2
This is my newest finetuned VibeVoice 7B (Large) model tailored to Hungarian language.
I trained LoRA for the LLM module, performed a full-finetune on the Diffusion head modules, and merged each of them into the base model.

To finetune the model I used the [following code](https://github.com/voicepowered-ai/VibeVoice-finetuning). 

Thank you for [JPGallegoar](https://github.com/jpgallegoar-vpai) for that amazing VibeVoice trainer!

## Inference
For inference, you can use 
- [this Comfyui node](https://github.com/Enemyx-net/VibeVoice-ComfyUI)
- Demo codes on [VibeVoice Community's repository](https://github.com/vibevoice-community/VibeVoice)

## Examples
These examples were made with 4bit inference. One can get even better results without quantization.

#### Sample 1
```
"Az utcák lassan megteltek emberekkel, ahogy a város ébredezett.
A kávézók teraszain gőzölgő csészék mellett beszélgettek az emberek, miközben a villamos csilingelve gördült el a sarkon.
A levegőben friss péksütemény illata keveredett a tavaszi széllel.
Minden arra utalt, hogy egy nyugodt, szép nap veszi kezdetét."
```
<div style="display: flex; gap: 20px; align-items: center;">
  <div style="flex: 1;">
    <strong>Fine-tuned Model</strong>
    <audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_withmodel_1.flac" style="width: 100%;"></audio>
  </div>
  <div style="flex: 1;">
    <strong>Base Model</strong>
    <audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_no_model_1.flac" style="width: 100%;"></audio>
  </div>
</div>

---

#### Sample 2
```
"Őrült űző üldöző őz őrjöngő őrült őrzőjével ügető ürge üvöltözött.
Örvénylő örömök örökös özönével ölelő ösvényeken ődöngő űrlények ütköztek össze önérzetesen."
```
<div style="display: flex; gap: 20px; align-items: center;">
  <div style="flex: 1;">
    <strong>Fine-tuned Model</strong>
    <audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_withmodel_2.flac" style="width: 100%;"></audio>
  </div>
  <div style="flex: 1;">
    <strong>Base Model</strong>
    <audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_no_model_2.flac" style="width: 100%;"></audio>
  </div>
</div>

---

#### Sample 3
```
"Csapzott cserecsapat cserebogár csapongott cserepes cseresznyecsokrok csücskében,
s közben csipcsup csipogással csipkedte csípős csipkebokor csúcsát."
```
<div style="display: flex; gap: 20px; align-items: center;">
  <div style="flex: 1;">
    <strong>Fine-tuned Model</strong>
    <audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_withmodel_3.flac" style="width: 100%;"></audio>
  </div>
  <div style="flex: 1;">
    <strong>Base Model</strong>
    <audio controls src="https://huggingface.co/Cseti/VibeVoice_7B_hun_v2/resolve/main/assets/test_no_model_3.flac" style="width: 100%;"></audio>
  </div>
</div>

**Important Notes:** This model is created as part of a fan project for research purposes only and is not intended for commercial use. 
The dataset I used might contain material, which are protected by copyright. Users utilize the model at their own risk. 
Users are obligated to comply with copyright laws and applicable regulations. 
The model has been developed for research purposes, and it is not my intention to infringe on any copyright.