mistralai
/

Mistral-Small-24B-Instruct-2501

Model card Files Files and versions

juliendenize commited on Jul 28

Commit

9527884

·

verified ·

1 Parent(s): 9be434b

Update params.json

Files changed (1) hide show

params.json +2 -1

params.json CHANGED Viewed

@@ -8,5 +8,6 @@
     "norm_eps": 1e-05,
     "vocab_size": 131072,
     "rope_theta": 100000000.0,
-    "max_seq_len": 32768
 }

     "norm_eps": 1e-05,
     "vocab_size": 131072,
     "rope_theta": 100000000.0,
+    "max_seq_len": 32768,
+    "max_position_embeddings": 32768
 }