Update README.md
Browse files
README.md
CHANGED
|
@@ -124,7 +124,7 @@ Try the model in [Google Colab Notebook](https://colab.research.google.com/drive
|
|
| 124 |
- **Language:** English
|
| 125 |
- **Finetuned from model:** [WavLM](https://huggingface.co/microsoft/wavlm-large), [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
|
| 126 |
- **Model Size:** 1.5 B
|
| 127 |
-
- **Checkpoint:**
|
| 128 |
- **Adapters:** r=8, alpha=16
|
| 129 |
- **lr** : 1e-4
|
| 130 |
- **gradient accumulation steps:** 8
|
|
|
|
| 124 |
- **Language:** English
|
| 125 |
- **Finetuned from model:** [WavLM](https://huggingface.co/microsoft/wavlm-large), [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
|
| 126 |
- **Model Size:** 1.5 B
|
| 127 |
+
- **Checkpoint:** 1200 k steps (bs=1)
|
| 128 |
- **Adapters:** r=8, alpha=16
|
| 129 |
- **lr** : 1e-4
|
| 130 |
- **gradient accumulation steps:** 8
|