IberLang Classifier

Model Overview

The IberLang classifier is a fine-tuned version of the Whisper Medium model, developed specifically for language recognition across the Iberian linguistic spectrum. Trained to accurately identify Spanish, Catalan, Galician, Euskera (Basque), and Occitan, this model enhances Whisper’s multilingual capabilities for regional language identification tasks.

The pre-trained base used for fine-tuning was: openai/whisper-medium.

Quickstart

from transformers import pipeline
import torch, librosa

classifier = pipeline(
    "audio-classification",
    model="Ugiat/IberLang",
    device=0 if torch.cuda.is_available() else -1
)

audio_path = "sample.wav"

audio, _ = librosa.load(audio_path, sr=16000)

prediction = classifier(audio)

print(prediction[0]["label"])

Performance Evaluation

We evaluated the fine-tuned IberLang classifier against Whisper Large V3 using a reserved subset of our custom VoxLingua107 IberLang dataset containing 1200 audios. The results show substantial performance gains, particularly in the recognition of minority Iberian languages.

Model	Catalan	Basque	Galician	Occitan	Spanish
IberLang	0.902	0.96	0.915	0.655	1.0
Whisper-Large-V3	0.902	0.68	0.188	0.0	0.978

Fine-Tuning Process

The fine-tuning process followed a structured approach, including dataset preparation, model training, and optimization:

• Data Splitting: The dataset was shuffled and split into training (90%) and testing (10%) subsets.
• Training Setup:
  • Batch size: 4
  • Gradient accumulation steps: 8
  • Epoch: 3
  • Learning rate: 1e-5
  • Scheduler: Linear
  • Evaluation frequency: Every 300 steps
  • Checkpointing: Every 300 steps

License

This model, IberLang, is a fine-tuned version of Whisper Medium by OpenAI, licensed under the Apache License 2.0.

Fine-tuning and additional modifications were performed by Ugiat Technologies to improve multilingual language identification for Catalan, Galician, Basque, Spanish, and Occitan.

The resulting model and associated documentation are released under the Creative Commons Attribution 4.0 International License (CC BY 4.0).

When using this model, please cite both the original Whisper project and this fine-tuned version as appropriate.