Spaces:

moondream
/

test-space

Running on Zero

vikhyatk commited on Oct 28, 2024

Commit

86e64b5

verified ·

1 Parent(s): 811dbd7

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -15,7 +15,7 @@ tokenizer = AutoTokenizer.from_pretrained("vikhyatk/moondream2")
 moondream = AutoModelForCausalLM.from_pretrained(
     "vikhyatk/moondream-next", trust_remote_code=True,
     torch_dtype=torch.bfloat16, device_map={"": "cuda"},
-    attn_implementation="flash_attention_2"
 )
 moondream.eval()

 moondream = AutoModelForCausalLM.from_pretrained(
     "vikhyatk/moondream-next", trust_remote_code=True,
     torch_dtype=torch.bfloat16, device_map={"": "cuda"},
+    attn_implementation="flash_attention_2", use_auth_token=auth_token
 )
 moondream.eval()