See
MPEG
for an example of a 3D reconstruction
Slide 31 of 34