Hi,
I think the current contrastive search implementation overrides the model Output type to the default type, which can create issue for models that rely on subclasses. I have opened a PR here transformers-community/contrastive-search · allow Output subclasses in contrastive search , not sure how I can contact someone from the team to have a look. Happy to discuss, thanks in advance!