Update README.md
Browse files
README.md
CHANGED
|
@@ -21,17 +21,6 @@ language:
|
|
| 21 |
This model is a fine-tuned version of [unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit](https://huggingface.co/unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit).
|
| 22 |
It has been trained using [TRL](https://github.com/huggingface/trl).
|
| 23 |
|
| 24 |
-
## Quick start
|
| 25 |
-
|
| 26 |
-
```python
|
| 27 |
-
from transformers import pipeline
|
| 28 |
-
|
| 29 |
-
question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
|
| 30 |
-
generator = pipeline("text-generation", model="None", device="cuda")
|
| 31 |
-
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
|
| 32 |
-
print(output["generated_text"])
|
| 33 |
-
```
|
| 34 |
-
|
| 35 |
## Training procedure
|
| 36 |
|
| 37 |
|
|
@@ -39,7 +28,21 @@ print(output["generated_text"])
|
|
| 39 |
|
| 40 |
This model was trained with SFT.
|
| 41 |
|
| 42 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
|
| 44 |
```python
|
| 45 |
import torch
|
|
|
|
| 21 |
This model is a fine-tuned version of [unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit](https://huggingface.co/unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit).
|
| 22 |
It has been trained using [TRL](https://github.com/huggingface/trl).
|
| 23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
## Training procedure
|
| 25 |
|
| 26 |
|
|
|
|
| 28 |
|
| 29 |
This model was trained with SFT.
|
| 30 |
|
| 31 |
+
## Usage
|
| 32 |
+
|
| 33 |
+
### HuggingFace Authentication
|
| 34 |
+
```python
|
| 35 |
+
import os
|
| 36 |
+
from huggingface_hub import login
|
| 37 |
+
|
| 38 |
+
# Set the Hugging Face API token
|
| 39 |
+
os.environ["HUGGINGFACEHUB_API_TOKEN"] = "<your_huggingface_token>"
|
| 40 |
+
|
| 41 |
+
# # Initialize API
|
| 42 |
+
login(os.environ.get("HUGGINGFACEHUB_API_TOKEN"))
|
| 43 |
+
```
|
| 44 |
+
|
| 45 |
+
### Inference
|
| 46 |
|
| 47 |
```python
|
| 48 |
import torch
|