openbmb
/

MiniCPM-Embedding

Feature Extraction

sentence-transformers

Model card Files Files and versions

Kaguya-19 commited on Oct 31, 2024

Commit

c0cb2de

·

verified ·

1 Parent(s): 0fc89f5

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -17,7 +17,7 @@
   "initializer_range": 0.1,
   "intermediate_size": 5760,
   "is_causal": false,
-  "max_position_embeddings": 2048,
   "num_attention_heads": 36,
   "num_hidden_layers": 40,
   "num_key_value_heads": 36,

   "initializer_range": 0.1,
   "intermediate_size": 5760,
   "is_causal": false,
+  "max_position_embeddings": 512,
   "num_attention_heads": 36,
   "num_hidden_layers": 40,
   "num_key_value_heads": 36,