  Recently it has been shown that a realistic description of the medium via
event-by-event viscous hydrodynamics plays an important role in the
long-standing $R_\text{AA}$ vs. $v_2$ puzzle at high $p_T$. In this proceedings
we begin to extend this approach to the heavy flavor sector by investigating
the effects of full event-by-event fluctuating hydrodynamic backgrounds on the
nuclear suppression factor and $v_2\{2\}$ of heavy flavor mesons and
non-photonic electrons at intermediate to high $p_T$. We also show results for
$v_3\{2\}$ of $B^0$ and D$^0$ for PbPb collisions at $\sqrt{s}=2.76$ TeV.
