  The combination of Rashba spin-orbit coupling and electron correlations can
induce unusual phenomena in the metallic interface between SrTiO$_3$ and
LaAlO$_3$. We consider effects of Rashba spin-orbit coupling at this interface
in the context of the recent observation of anisotropic magnetism. Firstly, we
show how Rashba spin-orbit coupling in a system near a band-edge can account
for the observed magnetic anisotropy. Secondly, we investigate the coupling
between in-plane magnetic-moment anisotropy and nematicity in the form of an
orbital imbalance between d$_{xz}$ / d$_{yz}$ orbitals. We estimate this
coupling to be substantial in the low electron density regime. Such an orbital
ordering can affect magneto transport.
