TheStageAI
/

Elastic-Llama-3.2-1B-Instruct

Text Generation

text2text-generation

Model card Files Files and versions

psynote123 commited on Apr 24

Commit

c26bb9d

·

verified ·

1 Parent(s): 81fcc5c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -59,7 +59,7 @@ model = AutoModelForCausalLM.from_pretrained(
     token=hf_token,
     torch_dtype=torch.bfloat16,
     attn_implementation="sdpa",
-    mode='s'
 ).to(device)
 model.generation_config.pad_token_id = tokenizer.eos_token_id

     token=hf_token,
     torch_dtype=torch.bfloat16,
     attn_implementation="sdpa",
+    mode='S'
 ).to(device)
 model.generation_config.pad_token_id = tokenizer.eos_token_id