  This paper presents our models for WNUT 2020 shared task2. The shared task2
involves identification of COVID-19 related informative tweets. We treat this
as binary text classification problem and experiment with pre-trained language
models. Our first model which is based on CT-BERT achieves F1-score of 88.7%
and second model which is an ensemble of CT-BERT, RoBERTa and SVM achieves
F1-score of 88.52%.
