Sparse and Noisy LiDAR Completion with RGB Guidance and Uncertainty
IAPR International Workshop on Machine Vision Applications(2019)
Abstract
This work proposes a new method to accurately complete sparse LiDAR maps guided by RGB images. For autonomous vehicles and robotics the use of LiDAR is indispensable in order to achieve precise depth predictions. A multitude of applications depend on the awareness of their surroundings, and use depth cues to reason and react accordingly. On the one hand, monocular depth prediction methods fail to generate absolute and precise depth maps. On the other hand, stereoscopic approaches are still significantly outperformed by LiDAR based approaches. The goal of the depth completion task is to generate dense depth predictions from sparse and irregular point clouds which are mapped to a 2D plane. We propose a new framework which extracts both global and local information in order to produce proper depth maps. We argue that simple depth completion does not require a deep network. However, we additionally propose a fusion method with RGB guidance from a monocular camera in order to leverage object information and to correct mistakes in the sparse input. This improves the accuracy significantly. Moreover, confidence masks are exploited in order to take into account the uncertainty in the depth predictions from each modality. This fusion method outperforms the state-of-the-art and ranks first on the KITTI depth completion benchmark [21]. Our code with visualizations is available at https://github.com/wvangansbeke/Sparse-Depth-Completion.
MoreTranslated text
Key words
RGB guidance,sparse LiDAR maps,RGB images,autonomous vehicles,robotics,precise depth predictions,depth cues,monocular depth prediction methods,absolute depth maps,precise depth maps,stereoscopic approaches,LiDAR based approaches,depth completion task,dense depth predictions,sparse point clouds,irregular point clouds,global information,local information,fusion method,monocular camera,sparse input,KITTI depth completion benchmark,object information
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined