huihui-ai
/

Meta-Llama-3.1-8B-Instruct-abliterated

Text Generation

text-generation-inference

Model card Files Files and versions

huihui-ai commited on Sep 23, 2024

Commit

fa62f7c

·

verified ·

1 Parent(s): 15f6d37

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -19,10 +19,10 @@ The following data has been re-evaluated and calculated as the average for each
 | Benchmark   | Llama-3.1-8b-Instruct | Meta-Llama-3.1-8B-Instruct-abliterated |
 |-------------|-----------------------|----------------------------------------|
-| IF_Eval     | 80.0                  | 78.98                                  |
-| MMLU Pro    | 36.34                 | 35.91                                  |
 | TruthfulQA  | 52.98                 | **55.42**                              |
-| BBH         | 48.72                 | 47.0                                   |
 | GPQA        | 33.55                 | **33.93**                              |
 The script used for evaluation can be found inside this repository under /eval.sh, or click [here](https://huggingface.co/huihui-ai/Meta-Llama-3.1-8B-Instruct-abliterated/blob/main/eval.sh)

 | Benchmark   | Llama-3.1-8b-Instruct | Meta-Llama-3.1-8B-Instruct-abliterated |
 |-------------|-----------------------|----------------------------------------|
+| IF_Eval     | **80.0**              | 78.98                                  |
+| MMLU Pro    | **36.34**             | 35.91                                  |
 | TruthfulQA  | 52.98                 | **55.42**                              |
+| BBH         | **48.72**             | 47.0                                   |
 | GPQA        | 33.55                 | **33.93**                              |
 The script used for evaluation can be found inside this repository under /eval.sh, or click [here](https://huggingface.co/huihui-ai/Meta-Llama-3.1-8B-Instruct-abliterated/blob/main/eval.sh)