Update README.md
Browse files
README.md
CHANGED
|
@@ -10,4 +10,26 @@ base_model:
|
|
| 10 |
- meta-llama/Llama-3.2-1B-Instruct
|
| 11 |
pipeline_tag: text-generation
|
| 12 |
---
|
| 13 |
-

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
- meta-llama/Llama-3.2-1B-Instruct
|
| 11 |
pipeline_tag: text-generation
|
| 12 |
---
|
| 13 |
+

|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
## Score
|
| 17 |
+
|
| 18 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 19 |
+
|----------------|------:|------|-----:|--------|---|-----:|---|------|
|
| 20 |
+
|kobest_boolq | 1|none | 5|acc |↑ |0.5726|± |0.0132|
|
| 21 |
+
| | |none | 5|f1 |↑ |0.5725|± | N/A|
|
| 22 |
+
|kobest_copa | 1|none | 5|acc |↑ |0.5200|± |0.0158|
|
| 23 |
+
| | |none | 5|f1 |↑ |0.5189|± | N/A|
|
| 24 |
+
|kobest_hellaswag| 1|none | 5|acc |↑ |0.3640|± |0.0215|
|
| 25 |
+
| | |none | 5|acc_norm|↑ |0.4380|± |0.0222|
|
| 26 |
+
| | |none | 5|f1 |↑ |0.3592|± | N/A|
|
| 27 |
+
|kobest_sentineg | 1|none | 5|acc |↑ |0.5642|± |0.0249|
|
| 28 |
+
| | |none | 5|f1 |↑ |0.5554|± | N/A|
|
| 29 |
+
|kobest_wic | 1|none | 5|acc |↑ |0.5087|± |0.0141|
|
| 30 |
+
| | |none | 5|f1 |↑ |0.4979|± | N/A|
|
| 31 |
+
|
| 32 |
+
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|
| 33 |
+
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|
| 34 |
+
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.2995|± |0.0126|
|
| 35 |
+
| | |strict-match | 5|exact_match|↑ |0.2987|± |0.0126|
|