Hell everyone! I’ve been trying to finetune a GPT based model using SFT trainer from TRl library. it is my understanding that you could directly pass a non-tokenized dataset and the SFT trainer class handles the tokenization internally. However after defining my dataset(with only one row named “te…

Finetuning with SFTtrainer

nielsr June 12, 2024, 2:16pm 2

Topic		Replies	Views
Fine tune with SFTTrainer Intermediate	17	15791	September 12, 2024
Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' 🤗Transformers	2	790	July 24, 2024
Help using sfttrainer with data collator, peft, and tokenizer template Intermediate	0	162	July 23, 2024
Getting error - trainer.train() 🤗Transformers	4	1021	June 3, 2024
Error using SFTTrainer: Make sure that your dataset has enough samples to at least yield one packed sequence Beginners	9	3093	November 1, 2024