Photon-Efficient 3D Reconstruction with A Coarse-to-Fine Neural Network

•A novel Coarse-to-Fine neural network for photon-efficient 3D reconstruction is proposed.•The proposed network achieves SOTA performance on the photon-efficient 3D reconstruction.•Introducing transformer structure in the proposed Coarse-Interval-Localization-Network.•A Fine-Maximum-Localization-Network with position encoding and temporal attention modules is proposed.