  We give some conditions on a family of abelian covers of ${\mathbb P}^1$ of
genus $g$ curves, that ensure that the family yields a subvariety of ${\mathsf
A}_g$ which is not totally geodesic, hence it is not Shimura. As a consequence,
we show that for any abelian group $G$, there exists an integer $M$ which only
depends on $G$ such that if $g >M$, then the family yields a subvariety of
${\mathsf A}_g$ which is not totally geodesic. We prove then analogous results
for families of abelian covers of ${\tilde C}_t \rightarrow {\mathbb P}^1 =
{\tilde C}_t/{\tilde G}$ with an abelian Galois group ${\tilde G}$ of even
order, proving that under some conditions, if $\sigma \in {\tilde G}$ is an
involution, the family of Pryms associated with the covers ${\tilde C}_t
\rightarrow C_t= {\tilde C}_t/\langle \sigma \rangle$ yields a subvariety of
${\mathsf A}_{p}^{\delta}$ which is not totally geodesic. As a consequence, we
show that if ${\tilde G} =({\mathbb Z}/N{\mathbb Z})^m$ with $N$ even, and
$\sigma$ is an involution in ${\tilde G}$, there exists an integer $M(N)$ which
only depends on $N$ such that, if ${\tilde g} = g({\tilde C}_t) > M(N)$, then
the subvariety of the Prym locus in ${\mathsf A}^{\delta}_{p}$ induced by any
such family is not totally geodesic (hence it is not Shimura).
