Undi95
/

Mistral-11B-v0.1

Text Generation

text-generation-inference

Model card Files Files and versions

Undi95 commited on Oct 9, 2023

Commit

e969827

·

1 Parent(s): ff0e031

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -49,7 +49,7 @@ slices:
     - model: mistralai/Mistral-7B-v0.1
       layer_range: [8, 32]
 merge_method: passthrough
-dtype: float16
 ```

     - model: mistralai/Mistral-7B-v0.1
       layer_range: [8, 32]
 merge_method: passthrough
+dtype: bfloat16
 ```