Hugging Face's logo

Spaces:
binary1ne
/
vllm-llama2
Paused

App Files Community
binary1ne commited on
Commit
550a0f3
·
verified ·
1 Parent(s): 4ddb93e

Update Dockerfile

Browse files
Files changed (1) hide show
  1. Dockerfile +1 -1
Dockerfile CHANGED
@@ -10,7 +10,7 @@ ENV VLLM_CPU_KVCACHE_SPACE=8
10
  ENV OMP_NUM_THREADS=2
11
  ENV VLLM_WORKER_MULTIPROC_METHOD=spawn
12
  ENV VLLM_ARGS="--dtype auto"
13
- ENV VLLM_CPU_OMP_THREADS_BIND=0-29
14
 
15
  # -----------------------------
16
  # Install dependencies
 
10
  ENV OMP_NUM_THREADS=2
11
  ENV VLLM_WORKER_MULTIPROC_METHOD=spawn
12
  ENV VLLM_ARGS="--dtype auto"
13
+ ENV VLLM_CPU_OMP_THREADS_BIND=0-4
14
 
15
  # -----------------------------
16
  # Install dependencies