  Using the decomposition of Jacobians with group action, we prove the
non-existence of some Shimura subvarieties in the moduli space of ppav $A_{g}$
arising from families of dihedral and quaternionic covers of the complex
projective line $\mathbb{P}^1$.
