  As the quality of machine translation rises and neural machine translation
(NMT) is moving from sentence to document level translations, it is becoming
increasingly difficult to evaluate the output of translation systems.
  We provide a test suite for WMT19 aimed at assessing discourse phenomena of
MT systems participating in the News Translation Task. We have manually checked
the outputs and identified types of translation errors that are relevant to
document-level translation.
