I'm a huge fan of mathematical physics and I know what the formal definitions of those  two areas are, I've seen them. But I still get completely baffled when someone asks me to explain it simply. The difference is obvious to me, but I just can't seem to put it into words in a satisfying enough manner. So I'm asking you to help me...

What is the essential difference between theoretical physics and mathematical physics?

or if you prefer the rephrased version...

What was the motivation for introducing the name "mathematical physics" as a separate entity?

(It doesn't matter if you're one of those people who don't like labels, the thing is that we do have these two separated very often in academia.)

Theoretical physics is the field that develops theories about how nature operates. It is fundamentally physics, in that the ultimate goal is to describe reality. It is informed by experiment, and at the same time it extends the results of experiments, making predictions about what has not been physically tested. This is accomplished using the language of mathematics, and often the demands of theoretical physicists force mathematicians to extend this language in new directions, but it is not concerned with developing the language of math. Theoretical physicists are, among other things, physicists who are very well-versed in math (which is not to say other physicists are not - please don't hurt me).

Mathematical physics, on the other hand, is a branch of mathematics. It explores relations between abstract concepts, proves certain results contingent upon certain hypotheses, and establishes an interlinked set of tools that can be used to study anything that happens to match the relations and hypotheses on hand. This branch in particular is motivated by the theories used in physics. It may seek to prove certain truths that were simply assumed by physicists, or carefully delineate the conditions under which certain theories hold, or even provide generally applicable tools to physicists, who can in turn apply them to nature. Mathematical physicists are mathematicians who are intrigued/inspired by physics.

One could say that mathematical physics is concerned with the internal, logical consistency of physical theories, while theoretical physics is concerned with finding the right model to describe the world around us. Very roughly, one might diagram these things as shown below.
$$ \text{Mathematical physics} \Longleftrightarrow \text{Theoretical physics} \Longleftrightarrow \text{Experimental physics} $$
