  We use the Keck Deep Fields UGRI catalog of z~4, 3, and 2 UV-selected
galaxies to study the evolution of the rest-frame 1700A luminosity density at
high redshift. The ability to reliably constrain the contribution of faint
galaxies is critical and our data do so as they reach to M*+2 even at z~4 and
deeper still at lower redshifts. We find that the luminosity density at high
redshift is dominated by the hitherto poorly studied galaxies fainter than L*,
and, indeed, the the bulk of the UV light in the high-z Universe comes from
galaxies in the luminosity range L=0.1-1L*. It is these faint galaxies that
govern the behavior of the total UV luminosity density. Overall, there is a
gradual rise in luminosity density starting at z~4 or earlier, followed by a
shallow peak or a plateau within z~3--1, and then followed by the well-know
plunge at lower redshifts. Within this total picture, luminosity density in
sub-L* galaxies evolves more rapidly at high redshift, z>~2, than that in more
luminous objects. However, this is reversed at lower redshifts, z<~1, a
reversal that is reminiscent of galaxy downsizing. Within the context of the
models commonly used in the observational literature, there seemingly aren't
enough faint or bright LBGs to maintain ionization of intergalactic gas even as
late as z~4. This is particularly true at earlier epochs and even more so if
the faint-end evolutionary trends we observe at z~3 and 4 continue to higher
redshifts. Apparently the Universe must be easier to reionize than some recent
studies have assumed. Nevertheless, sub-L* galaxies do dominate the total UV
luminosity density at z>~2 and this dominance further highlights the need for
follow-up studies that will teach us more about these very numerous but thus
far largely unexplored systems.
