Photo Repair and 3D Structure from Flatbed Scanners Using 4- and 2-Source Photometric Stereo.

We recently introduced a technique that allows 3D information to be captured from a conventional flatbed scanner [22]. The technique requires no hardware modification and allows untrained users to easily capture 3D datasets. Once captured, these datasets can be used for interactive relighting and enhancement of surface detail on physical objects. We have also found that the method can be used to scan and repair damaged photographs. Since only the 3D structure on these photographs will typically be surface tears and creases, our method provides an accurate procedure for automatically detecting these flaws without any user intervention. Once detected, automatic techniques, such as in-filling and texture synthesis, can be leveraged to seamlessly repair such damaged areas. We here provide a more thorough exposition and significant new material. We first present a method that is able to repair damaged photographs with minimal user interaction and then show how we can achieve similar results using a fully automatic process.