Update README.md
Browse files
README.md
CHANGED
|
@@ -26,7 +26,7 @@ besides that allowing to use it via SGLang without having to pull the repository
|
|
| 26 |
to point to the tokenizer path, so that Grok-2 can be deployed as:
|
| 27 |
|
| 28 |
```bash
|
| 29 |
-
python3 -m sglang.launch_server --model xai-org/grok-2 --tokenizer-path alvarobartt/grok-2-tokenizer --tp 8 --quantization fp8 --attention-backend triton
|
| 30 |
```
|
| 31 |
|
| 32 |
Rather than the former 2-step process:
|
|
@@ -34,7 +34,7 @@ Rather than the former 2-step process:
|
|
| 34 |
```bash
|
| 35 |
hf download xai-org/grok-2 --local-dir /local/grok-2
|
| 36 |
|
| 37 |
-
python3 -m sglang.launch_server --model /local/grok-2 --tokenizer-path /local/grok-2/tokenizer.tok.json --tp 8 --quantization fp8 --attention-backend triton
|
| 38 |
```
|
| 39 |
|
| 40 |
## Example
|
|
|
|
| 26 |
to point to the tokenizer path, so that Grok-2 can be deployed as:
|
| 27 |
|
| 28 |
```bash
|
| 29 |
+
python3 -m sglang.launch_server --model-path xai-org/grok-2 --tokenizer-path alvarobartt/grok-2-tokenizer --tp-size 8 --quantization fp8 --attention-backend triton
|
| 30 |
```
|
| 31 |
|
| 32 |
Rather than the former 2-step process:
|
|
|
|
| 34 |
```bash
|
| 35 |
hf download xai-org/grok-2 --local-dir /local/grok-2
|
| 36 |
|
| 37 |
+
python3 -m sglang.launch_server --model-path /local/grok-2 --tokenizer-path /local/grok-2/tokenizer.tok.json --tp-size 8 --quantization fp8 --attention-backend triton
|
| 38 |
```
|
| 39 |
|
| 40 |
## Example
|