Use BertLMHeadModel to finetunning a language model

davidhu March 30, 2021, 7:38am 1

Is it possible to use BertLMHeadModel to finetune a language model if i set the is_decoder=True ?

Topic		Replies	Views
Questions on the `BertModelLMHeadModel` 🤗Transformers	7	6318	October 5, 2020
Fine-tuning lm with nsp 🤗Transformers	0	1174	January 19, 2021
BERT2BERT Notebook for Models without GenerationMixin 🤗Transformers	0	291	November 12, 2020
BERT2RND EncoderDecoderModel predicts random words for Translation tasks 🤗Transformers	0	387	May 30, 2022
Smart Batching - speech up Bert finetune Intermediate	0	685	March 15, 2021