  By analyzing the motion of people and other objects in a scene, we
demonstrate how to infer depth, occlusion, lighting, and shadow information
from video taken from a single camera viewpoint. This information is then used
to composite new objects into the same scene with a high degree of automation
and realism. In particular, when a user places a new object (2D cut-out) in the
image, it is automatically rescaled, relit, occluded properly, and casts
realistic shadows in the correct direction relative to the sun, and which
conform properly to scene geometry. We demonstrate results (best viewed in
supplementary video) on a range of scenes and compare to alternative methods
for depth estimation and shadow compositing.
