  This paper proposes a new method for estimating the joint probability mass
function of a pair of discrete random variables. This estimator is used to
construct joint Shannon R\'enyi-Tsallis entropies, and the mutual information
estimates of a pair of discrete random variables. Almost sure consistency and
central limit Theorems are established. Our theorical results are validated by
simulations.
