arxiv:2411.15124
Victoria Graf
VGraf
AI & ML interests
None yet
Recent Activity
published
a dataset
9 days ago
VGraf/judged-pref-data
updated
a model
15 days ago
allenai/Olmo-3-7B-Think-DPO
Organizations
models
15
VGraf/mt_dpo
Feature Extraction
•
8B
•
Updated
•
5
VGraf/no_benign_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
3
VGraf/no_benign_stack_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
3
VGraf/8t_0.7p_safe_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
4
VGraf/8t_0.6p_safe_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
2
VGraf/8t_0.5p_safe_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
1
VGraf/7t_0.5p_safe_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
4
VGraf/6t_0.5p_safe_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
5
VGraf/5t_0.5p_safe_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
2
VGraf/4t_0.5p_safe_synth_mt_dpo_mix
Feature Extraction
•
8B
•
Updated
•
7
datasets
530
VGraf/judged-pref-data
Updated
•
14
VGraf/repeat_response_flip_tulu_5maxturns_big_truncated2048_gpt-4ochosen_gpt-3.5-turbo-0125rejected
Viewer
•
Updated
•
21.5k
•
18
VGraf/paraphrase_train_dev_8maxturns_truncated2048_gpt-4ochosen_gpt-3.5-turbo-0125rejected
Viewer
•
Updated
•
5.28k
•
32
VGraf/general_responses_dev_8maxturns_truncated2048_gpt-4ochosen_gpt-3.5-turbo-0125rejected
Viewer
•
Updated
•
5.19k
•
29
VGraf/self-talk_gpt3.5_gpt4o_prefpairs_truncated2048_Qwen__Qwen3-32Bchosen_Qwen__Qwen3-0.6Brejected
Viewer
•
Updated
•
10k
•
29
VGraf/repeat_tulu_5maxturns_big_truncated2048_Qwen__Qwen3-32Bchosen_Qwen__Qwen3-0.6Brejected
Viewer
•
Updated
•
4k
•
28
VGraf/paraphrase_train_dev_8maxturns_truncated2048_Qwen__Qwen3-32Bchosen_Qwen__Qwen3-0.6Brejected
Viewer
•
Updated
•
4k
•
22
VGraf/general_responses_dev_8maxturns_truncated2048_Qwen__Qwen3-32Bchosen_Qwen__Qwen3-0.6Brejected
Viewer
•
Updated
•
4k
•
21
VGraf/multiturn-dpo-synthetic-context
Viewer
•
Updated
•
44k
•
35
VGraf/olmo-3-preference-mix-deltas_reasoning-yolo_scottmix-chosen_qwen32b_rejected_qwen4b-DECON
Viewer
•
Updated
•
294k
•
65