  Let $\Phi$ be a pseudo-Anosov diffeomorphism of a compact (possibly
non-orientable) surface $\Sigma$ with one boundary component. We show that if
$b \in \pi_1(\Sigma)$ is the boundary word, $\phi \in
{\rm{Aut}}(\pi_1(\Sigma))$ is a representative of $\Phi$ fixing $b$, and
${\rm{ad}}_b$ denotes conjugation by $b$, then the orbits of $\langle \phi,
{\rm{ad}}_b \rangle\cong\mathbb{Z}^2$ in the graph of free factors of
$\pi_1(\Sigma)$ are quasi-isometrically embedded. It follows that for $N \geq
2$ the free factor graph for ${\rm{Aut}}(F_N)$ is not hyperbolic, in contrast
to the ${\rm{Out}}(F_N)$ case.
