Hugging Face's logo

YuchenLi01
/
ultrafeedbackSkyworkAgree_alignmentZephyr7BSftFull_sdpo_score_ebs64_lr1e-07_1

Text Generation
Transformers
Safetensors
mistral
Generated from Trainer
trl
dpo
conversational
text-generation-inference
Model card Files
xet
Community
YuchenLi01 commited on
Commit
a437d39
·
verified ·
1 Parent(s): 06ee5fb

Model save

Browse files
Files changed (7) hide show
  1. README.md +1 -1
  2. all_results.json +4 -4
  3. model-00001-of-00003.safetensors +1 -1
  4. model-00002-of-00003.safetensors +1 -1
  5. model-00003-of-00003.safetensors +1 -1
  6. train_results.json +4 -4
  7. trainer_state.json +0 -0
README.md CHANGED
@@ -27,7 +27,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yuchenl4/lmpref/runs/ultrafeedbackSkyworkAgree_alignmentZephyr7BSftFull_sdpo_score_ebs64_lr1e-07_1try1w57TeC7z8rWQ4sADPorANY8Aif4cQ8suqupyoENaOdhtn4)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yuchenl4/lmpref/runs/ultrafeedbackSkyworkAgree_alignmentZephyr7BSftFull_sdpo_score_ebs64_lr1e-07_1try1YjNR2ePBV6AubBCbBX0tE1QRs9NmiWfnD9BPhsBhA2Su2T)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
all_results.json CHANGED
@@ -1,9 +1,9 @@
1
  {
2
  "epoch": 1.0,
3
  "total_flos": 0.0,
4
- "train_loss": 0.48589274659230364,
5
- "train_runtime": 31202.7925,
6
  "train_samples": 45608,
7
- "train_samples_per_second": 1.462,
8
- "train_steps_per_second": 0.023
9
  }
 
1
  {
2
  "epoch": 1.0,
3
  "total_flos": 0.0,
4
+ "train_loss": 0.4744376012687095,
5
+ "train_runtime": 32853.0023,
6
  "train_samples": 45608,
7
+ "train_samples_per_second": 1.388,
8
+ "train_steps_per_second": 0.022
9
  }
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:981cc6c5b65d0e5d2d5eb8a99c23f14c2aad143626f8131c52a9db5d15ac9c4a
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a09ec493e56bcf84a6dd1ff3e182996530804663489da4867325d78ba57acbaf
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ceaf6536882d992f7fcbe555ca5938b7ebf3b34499d49fe2e31720207fe3b829
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ed0f9b5cf11bf945d4e0ed8dba8b8427b39e7c88b19f60233f7944457f3e1ea
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a22f25adfe1bf2bbf1b709177753e43335b0fa60a514d2d2c499b098744b4f1
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b83cefbec4c9e1fc6c3f87f27e70a85a329147917aae8b22ca284d0c04f2ac8
3
  size 4540516344
train_results.json CHANGED
@@ -1,9 +1,9 @@
1
  {
2
  "epoch": 1.0,
3
  "total_flos": 0.0,
4
- "train_loss": 0.48589274659230364,
5
- "train_runtime": 31202.7925,
6
  "train_samples": 45608,
7
- "train_samples_per_second": 1.462,
8
- "train_steps_per_second": 0.023
9
  }
 
1
  {
2
  "epoch": 1.0,
3
  "total_flos": 0.0,
4
+ "train_loss": 0.4744376012687095,
5
+ "train_runtime": 32853.0023,
6
  "train_samples": 45608,
7
+ "train_samples_per_second": 1.388,
8
+ "train_steps_per_second": 0.022
9
  }
trainer_state.json CHANGED
The diff for this file is too large to render. See raw diff