  In the present paper, we derive a renormalization formula "\`a la
Hardy-Littlewood" for the Gaussian exponential sums with an exact formula for
the remainder term. We use this formula to describe the typical growth of the
Gaussian exponential sums.
