danhtran2mind commited on
Commit
0ac0e16
·
verified ·
1 Parent(s): 0428321

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -12
README.md CHANGED
@@ -21,17 +21,6 @@ language:
21
  This model is a fine-tuned version of [unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit](https://huggingface.co/unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit).
22
  It has been trained using [TRL](https://github.com/huggingface/trl).
23
 
24
- ## Quick start
25
-
26
- ```python
27
- from transformers import pipeline
28
-
29
- question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
30
- generator = pipeline("text-generation", model="None", device="cuda")
31
- output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
32
- print(output["generated_text"])
33
- ```
34
-
35
  ## Training procedure
36
 
37
 
@@ -39,7 +28,21 @@ print(output["generated_text"])
39
 
40
  This model was trained with SFT.
41
 
42
- ## Inference Usage
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43
 
44
  ```python
45
  import torch
 
21
  This model is a fine-tuned version of [unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit](https://huggingface.co/unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit).
22
  It has been trained using [TRL](https://github.com/huggingface/trl).
23
 
 
 
 
 
 
 
 
 
 
 
 
24
  ## Training procedure
25
 
26
 
 
28
 
29
  This model was trained with SFT.
30
 
31
+ ## Usage
32
+
33
+ ### HuggingFace Authentication
34
+ ```python
35
+ import os
36
+ from huggingface_hub import login
37
+
38
+ # Set the Hugging Face API token
39
+ os.environ["HUGGINGFACEHUB_API_TOKEN"] = "<your_huggingface_token>"
40
+
41
+ # # Initialize API
42
+ login(os.environ.get("HUGGINGFACEHUB_API_TOKEN"))
43
+ ```
44
+
45
+ ### Inference
46
 
47
  ```python
48
  import torch