top_p must be in (0, 1], got 9 (#10)
Browse files- top_p must be in (0, 1], got 9 (0535967b3df04352de924ffb841d6ff8f299ab52)
Co-authored-by: Kai Song <[email protected]>
vllm_plugin_meralion/README.md
CHANGED
|
@@ -50,7 +50,7 @@ prompt = ("<start_of_turn>user\n"
|
|
| 50 |
|
| 51 |
sampling_params = SamplingParams(
|
| 52 |
temperature=1,
|
| 53 |
-
top_p=9,
|
| 54 |
top_k=50,
|
| 55 |
repetition_penalty=1.1,
|
| 56 |
seed=42,
|
|
|
|
| 50 |
|
| 51 |
sampling_params = SamplingParams(
|
| 52 |
temperature=1,
|
| 53 |
+
top_p=0.9,
|
| 54 |
top_k=50,
|
| 55 |
repetition_penalty=1.1,
|
| 56 |
seed=42,
|