  Caricature is an abstraction of a real person which distorts or exaggerates
certain features, but still retains a likeness. While most existing works focus
on 3D caricature reconstruction from 2D caricatures or translating 2D photos to
2D caricatures, this paper presents a real-time and automatic algorithm for
creating expressive 3D caricatures with caricature style texture map from 2D
photos or videos. To solve this challenging ill-posed reconstruction problem
and cross-domain translation problem, we first reconstruct the 3D face shape
for each frame, and then translate 3D face shape from normal style to
caricature style by a novel identity and expression preserving VAE-CycleGAN.
Based on a labeling formulation, the caricature texture map is constructed from
a set of multi-view caricature images generated by CariGANs. The effectiveness
and efficiency of our method are demonstrated by comparison with baseline
implementations. The perceptual study shows that the 3D caricatures generated
by our method meet people's expectations of 3D caricature style.
