Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -68,7 +68,7 @@ print(generated_text)
|
|
| 68 |
- **`fsd_div_type`** (str, default: "kl"): Type of divergence metric to use:
|
| 69 |
- `"kl"`: KL divergence (D_KL(candidate || target)) - measures how much information is lost when using the candidate distribution to approximate the target
|
| 70 |
- `"js"`: Jensen-Shannon divergence - a symmetric and bounded measure of distribution similarity
|
| 71 |
-
- `"draft_tokens"`: Absolute difference
|
| 72 |
|
| 73 |
### How It Works
|
| 74 |
|
|
|
|
| 68 |
- **`fsd_div_type`** (str, default: "kl"): Type of divergence metric to use:
|
| 69 |
- `"kl"`: KL divergence (D_KL(candidate || target)) - measures how much information is lost when using the candidate distribution to approximate the target
|
| 70 |
- `"js"`: Jensen-Shannon divergence - a symmetric and bounded measure of distribution similarity
|
| 71 |
+
- `"draft_tokens"`: Absolute difference between draft and target model probability of drafted token
|
| 72 |
|
| 73 |
### How It Works
|
| 74 |
|