  This paper describes Adam Mickiewicz University's (AMU) solution for the 4th
Shared Task on SlavNER. The task involves the identification, categorization,
and lemmatization of named entities in Slavic languages. Our approach involved
exploring the use of foundation models for these tasks. In particular, we used
models based on the popular BERT and T5 model architectures. Additionally, we
used external datasets to further improve the quality of our models. Our
solution obtained promising results, achieving high metrics scores in both
tasks. We describe our approach and the results of our experiments in detail,
showing that the method is effective for NER and lemmatization in Slavic
languages. Additionally, our models for lemmatization will be available at:
https://huggingface.co/amu-cai.
