mistralai
/

Mistral-Small-24B-Instruct-2501

Model card Files Files and versions

patrickvonplaten commited on Jan 30

Commit

43e3cdb

·

verified ·

1 Parent(s): f1f3cea

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -151,7 +151,7 @@ We recommand that you use Mistral-Small-Instruct-2501 in a server/client setting
 1. Spin up a server:
 ```
-vllm serve mistralai/Mistral-Small-24B-Instruct-2501 --tokenizer_mode mistral --config_format mistral --load_format mistral --enable-auto-tool-choice
 ```
 **Note:** Running Mistral-Small-Instruct-2501 on GPU requires 60 GB of GPU RAM.

 1. Spin up a server:
 ```
+vllm serve mistralai/Mistral-Small-24B-Instruct-2501 --tokenizer_mode mistral --config_format mistral --load_format mistral --tool-call-parser mistral --enable-auto-tool-choice
 ```
 **Note:** Running Mistral-Small-Instruct-2501 on GPU requires 60 GB of GPU RAM.