yuan-tian
/

chartgpt-llama3

Text Generation

text-generation-inference

text2text-generation

Model card Files Files and versions

yuan-tian commited on Oct 15, 2024

Commit

bd6ed33

·

verified ·

1 Parent(s): ebbe24d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -115,7 +115,7 @@ Previous Answer:
 ### Response:"""
 inputs = tokenizer(input_text, return_tensors="pt", padding=True).to("cuda")
-outputs = model.generate(**inputs)
 print(tokenizer.decode(outputs[0], skip_special_tokens = True))
 ```

 ### Response:"""
 inputs = tokenizer(input_text, return_tensors="pt", padding=True).to("cuda")
+outputs = model.generate(**inputs, max_new_tokens=256)
 print(tokenizer.decode(outputs[0], skip_special_tokens = True))
 ```