  We discuss a general approach to building non-asymptotic confidence bounds
for stochastic optimization problems. Our principal contribution is the
observation that a Sample Average Approximation of a problem supplies upper and
lower bounds for the optimal value of the problem which are essentially better
than the quality of the corresponding optimal solutions. At the same time, such
bounds are more reliable than "standard" confidence bounds obtained through the
asymptotic approach. We also discuss bounding the optimal value of MinMax
Stochastic Optimization and stochastically constrained problems. We conclude
with a simulation study illustrating the numerical behavior of the proposed
bounds.
