OpenNLPLab
/

TransNormerLLM3-15B-Intermediate-Checkpoints

Text Generation

Model card Files Files and versions

OpenNLPLab commited on Jan 12, 2024

Commit

8fd5614

·

verified ·

1 Parent(s): 4a8c07f

Publish step26000-100Btokens

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -49,8 +49,8 @@ This official repository unveils the TransNormerLLM3 model along with its open-s
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
-tokenizer = AutoTokenizer.from_pretrained("OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints", revision='step13000-50Btokens', trust_remote_code=True)
-model = AutoModelForCausalLM.from_pretrained("OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints", torch_dtype=torch.bfloat16,revision='step13000-50Btokens', device_map="auto", trust_remote_code=True)
 ```
 # Benchmark Results

 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
+tokenizer = AutoTokenizer.from_pretrained("OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints", revision='step26000-100Btokens', trust_remote_code=True)
+model = AutoModelForCausalLM.from_pretrained("OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints", torch_dtype=torch.bfloat16, revision='step26000-100Btokens', device_map="auto", trust_remote_code=True)
 ```
 # Benchmark Results