  Hoaxes are a recognised form of disinformation created deliberately, with
potential serious implications in the credibility of reference knowledge
resources such as Wikipedia. What makes detecting Wikipedia hoaxes hard is that
they often are written according to the official style guidelines. In this
work, we first provide a systematic analysis of the similarities and
discrepancies between legitimate and hoax Wikipedia articles, and introduce
Hoaxpedia, a collection of 311 Hoax articles (from existing literature as well
as official Wikipedia lists) alongside semantically similar real articles. We
report results of binary classification experiments in the task of predicting
whether a Wikipedia article is real or hoax, and analyze several settings as
well as a range of language models. Our results suggest that detecting
deceitful content in Wikipedia based on content alone, despite not having been
explored much in the past, is a promising direction.
