  We review with a tutorial scope the information theory foundations of quantum
statistical physics. Only a small proportion of the variables that characterize
a system at the microscopic scale can be controlled, for both practical and
theoretical reasons, and a probabilistic description involving the observers is
required. The criterion of maximum von Neumann entropy is then used for making
reasonable inferences. It means that no spurious information is introduced
besides the known data. Its outcomes can be given a direct justification based
on the principle of indifference of Laplace. We introduce the concept of
relevant entropy associated with some set of relevant variables; it
characterizes the information that is missing at the microscopic level when
only these variables are known. For equilibrium problems, the relevant
variables are the conserved ones, and the Second Law is recovered as a second
step of the inference process. For non-equilibrium problems, the increase of
the relevant entropy expresses an irretrievable loss of information from the
relevant variables towards the irrelevant ones. Two examples illustrate the
flexibility of the choice of relevant variables and the multiplicity of the
associated entropies: the thermodynamic entropy (satisfying the Clausius-Duhem
inequality) and the Boltzmann entropy (satisfying the H-theorem). The
identification of entropy with missing information is also supported by the
paradox of Maxwell's demon. Spin-echo experiments show that irreversibility
itself is not an absolute concept: use of hidden information may overcome the
arrow of time.
