  We propose a framework that extends synchronic polysemy annotation to
diachronic changes in lexical meaning, to counteract the lack of resources for
evaluating computational models of lexical semantic change. Our framework
exploits an intuitive notion of semantic relatedness, and distinguishes between
innovative and reductive meaning changes with high inter-annotator agreement.
The resulting test set for German comprises ratings from five annotators for
the relatedness of 1,320 use pairs across 22 target words.
