  The 2019 WMT Biomedical translation task involved translating Medline
abstracts. We approached this using transfer learning to obtain a series of
strong neural models on distinct domains, and combining them into multi-domain
ensembles. We further experiment with an adaptive language-model ensemble
weighting scheme. Our submission achieved the best submitted results on both
directions of English-Spanish.
