Siliang Zeng's picture

1

Siliang Zeng

SiliangZ

·

https://siliangzeng.github.io/index.html

AI & ML interests

Alignment, RLHF, LLM

Organizations

spaces 1

Wiki Tool Use

models 19

SiliangZ/zephyr-7b-dpo-full

7B • Updated Mar 14 • 4

SiliangZ/mistral-irl-iter2-iterative-dpo

Text Generation • 7B • Updated Jan 20 • 4

SiliangZ/RM_Zephyr_dpo_init_ultrafeedbck_lr_5e7

Text Classification • 7B • Updated Jan 19 • 4

SiliangZ/RM_Zephyr_dpo_init_ultrafeedbck_lr_5e6

Text Classification • 7B • Updated Jan 19 • 4

SiliangZ/RM_Mistral_sft_init_ultrafeedbck_lr_5e7

Text Classification • 7B • Updated Jan 19 • 3

SiliangZ/RM_Mistral_sft_init_ultrafeedbck_lr_5e6

Text Classification • 7B • Updated Jan 19 • 189

SiliangZ/RM_mistral_irl2_initilized_from_sft_lr_5e7_idpo

7B • Updated Dec 3, 2024 • 4

SiliangZ/RM_mistral_irl2_initilized_from_irl1_rm_lr_5e7_idpo

7B • Updated Dec 3, 2024 • 2

SiliangZ/RM_mistral_7b_sft_beta_ultrachat_200k_mistral_sft_temp07_lr_5e7

7B • Updated Dec 1, 2024 • 3

SiliangZ/mistral-7b-sft-beta-rm-mistral-sft-temp07-lr-5e7-iter1

Text Generation • 7B • Updated Dec 1, 2024 • 5

datasets 26

SiliangZ/mistral_irl3_rm_data_idpo

Viewer • Updated Jan 21 • 208k • 9

SiliangZ/mistral_irl3_rm_data_combined_idpo

Viewer • Updated Jan 20 • 624k • 20

SiliangZ/mistral_irl2_rm_data_combined_idpo

Viewer • Updated Nov 30, 2024 • 416k • 19

SiliangZ/AIHF_Online_RLHF_Iter2

Viewer • Updated Nov 18, 2024 • 20k • 20

SiliangZ/AIHF_Online_RLHF_Iter1

Viewer • Updated Nov 17, 2024 • 20k • 14

SiliangZ/ultrafeedback_with_demo_sft_pairs_temp07

Viewer • Updated Nov 14, 2024 • 269k • 15

SiliangZ/ultrachat_200k_mistral_sft_iter1_iter2_temp1_generations

Viewer • Updated Oct 30, 2024 • 624k • 9

SiliangZ/ultrachat_200k_mistral_sft_temp1_iter1

Viewer • Updated Oct 25, 2024 • 416k • 26

SiliangZ/ultrachat_200k_mistral_sft_and_mistral_irl1_round1_temp07

Viewer • Updated Oct 25, 2024 • 416k • 19 • 1

SiliangZ/ultrachat_200k_mistral_sft_temp1

Viewer • Updated Oct 24, 2024 • 231k • 20

View 26 datasets