  We consider a non-atomic congestion game where each decision maker performs
selfish optimization over states of a common MDP. The decision makers optimize
for their own expected costs, and influence each other through congestion
effects on the state-action costs. We analyze on the sensitivity of MDP
congestion game equilibria to uncertainty and perturbations in the state-action
costs by applying an implicit function type analysis. The occurrence of a
stochastic Braess paradox is defined, analyzed based on sensitivity of game
equilibria and demonstrated in simulation. We further analyze how the
introduction of stochastic dynamics affects the magnitude of Braess paradox in
comparison to deterministic dynamics.
