Matrix commited on
Commit
6de796d
·
verified ·
1 Parent(s): a3fbeb6

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -47,12 +47,12 @@ Invoke the llama.cpp server or the CLI.
47
 
48
  ### CLI:
49
  ```bash
50
- llama-cli --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_m.gguf -p "The meaning to life and the universe is"
51
  ```
52
 
53
  ### Server:
54
  ```bash
55
- llama-server --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_m.gguf -c 2048
56
  ```
57
 
58
  Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
@@ -69,9 +69,9 @@ cd llama.cpp && LLAMA_CURL=1 make
69
 
70
  Step 3: Run inference through the main binary.
71
  ```
72
- ./llama-cli --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_m.gguf -p "The meaning to life and the universe is"
73
  ```
74
  or
75
  ```
76
- ./llama-server --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_m.gguf -c 2048
77
  ```
 
47
 
48
  ### CLI:
49
  ```bash
50
+ llama-cli --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_s.gguf -p "The meaning to life and the universe is"
51
  ```
52
 
53
  ### Server:
54
  ```bash
55
+ llama-server --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_s.gguf -c 2048
56
  ```
57
 
58
  Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
 
69
 
70
  Step 3: Run inference through the main binary.
71
  ```
72
+ ./llama-cli --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_s.gguf -p "The meaning to life and the universe is"
73
  ```
74
  or
75
  ```
76
+ ./llama-server --hf-repo matrixportal/Llama3.1-TheiaFire-DarkFusion-8B-GGUF --hf-file llama3.1-theiafire-darkfusion-8b-q4_k_s.gguf -c 2048
77
  ```