Update README.md
Browse files
README.md
CHANGED
|
@@ -117,7 +117,16 @@ The model can be used with the following frameworks;
|
|
| 117 |
We recommend using this model with the [vLLM library](https://github.com/vllm-project/vllm)
|
| 118 |
to implement production-ready inference pipelines.
|
| 119 |
|
| 120 |
-
**Note**: We recommond using a relatively low temperature, such as `temperature=0.15`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 121 |
|
| 122 |
**_Installation_**
|
| 123 |
|
|
|
|
| 117 |
We recommend using this model with the [vLLM library](https://github.com/vllm-project/vllm)
|
| 118 |
to implement production-ready inference pipelines.
|
| 119 |
|
| 120 |
+
**Note 1**: We recommond using a relatively low temperature, such as `temperature=0.15`.
|
| 121 |
+
**Note 2**: Make sure to add a system prompt to the model to best tailer it for your needs. If you want to use the model as a general assistant, we recommend the following
|
| 122 |
+
system prompt:
|
| 123 |
+
|
| 124 |
+
```
|
| 125 |
+
system_prompt = """You are Mistral Small 3, a Large Language Model (LLM) created by Mistral AI, a French startup headquartered in Paris.
|
| 126 |
+
Your knowledge base was last updated on 2023-10-01. The current date is 2025-01-30.
|
| 127 |
+
When you're not sure about some information, you say that you don't have the information and don't make up anything.
|
| 128 |
+
If the user's question is not clear, ambiguous, or does not provide enough context for you to accurately answer the question, you do not try to answer it right away and you rather ask the user to clarify their request (e.g. \"What are some good restaurants around me?\" => \"Where are you?\" or \"When is the next flight to Tokyo\" => \"Where do you travel from?\")"""
|
| 129 |
+
```
|
| 130 |
|
| 131 |
**_Installation_**
|
| 132 |
|