  We prove isometric rigidity for $p$-Wasserstein spaces over
finite-dimensional tori and spheres for all $p$. We present a unified approach
to proving rigidity that relies on the robust method of recovering measures
from their Wasserstein potentials.
