  This paper explores the task of language-agnostic speaker replication, a
novel endeavor that seeks to replicate a speaker's voice irrespective of the
language they are speaking. Towards this end, we introduce a multi-level
attention aggregation approach that systematically probes and amplifies various
speaker-specific attributes in a hierarchical manner. Through rigorous
evaluations across a wide range of scenarios including seen and unseen speakers
conversing in seen and unseen lingua, we establish that our proposed model is
able to achieve substantial speaker similarity, and is able to generalize to
out-of-domain (OOD) cases.
