  We investigate how well BERT performs on predicting factuality in several
existing English datasets, encompassing various linguistic constructions.
Although BERT obtains a strong performance on most datasets, it does so by
exploiting common surface patterns that correlate with certain factuality
labels, and it fails on instances where pragmatic reasoning is necessary.
Contrary to what the high performance suggests, we are still far from having a
robust system for factuality prediction.
