Photogrammetry
I was watching some videos on photogrammetry (part 1 and part 2) by Josef Prusa.
It is very similar to the photo-stitching work people used for 2D images, plus the point cloud extraction. I remember seeing something done by Microsoft Research maybe around 2013, but I cannot find it.