Snapshot depth - spectral imaging based on image mapping and light field

Abstract In recent years, the snapshot multi - dimensional imaging technology is emerging and becomes an increasing research focus. Especially, the spatial, spectral and depth information of scenes is particularly useful in target detection, recognition, tracking, scene classification et al. This paper proposes a snapshot depth - spectral imaging architecture based on image mapping and light field to realize the capture of depth - spectral information in a single snapshot. Specifically, we modulate the depth - spectral information of targets onto a two - dimensional sensor in three steps. Firstly, an image mapper is utilized to slice and reflect the first image to different directions and make void space between two adjacent strip images. This is a spatial modulation processing. Then, a direct vision prism is used to disperse the mapped and collimated light. Finally, the light field sensor with a micro - lens array captures the dispersed light field. Complimentary, we also proposed the reconstruction method under the remapping and digital refocus framework. Through simulations, we demonstrate that the proposed snapshot depth – spectral imaging system is effective to measure the depth - spectral information of scenes in a single snapshot time.