GoMVS: Geometrically Consistent Cost Aggregation for Multi-View Stereo
arxiv(2024)
摘要
Matching cost aggregation plays a fundamental role in learning-based
multi-view stereo networks. However, directly aggregating adjacent costs can
lead to suboptimal results due to local geometric inconsistency. Related
methods either seek selective aggregation or improve aggregated depth in the 2D
space, both are unable to handle geometric inconsistency in the cost volume
effectively. In this paper, we propose GoMVS to aggregate geometrically
consistent costs, yielding better utilization of adjacent geometries. More
specifically, we correspond and propagate adjacent costs to the reference pixel
by leveraging the local geometric smoothness in conjunction with surface
normals. We achieve this by the geometric consistent propagation (GCP) module.
It computes the correspondence from the adjacent depth hypothesis space to the
reference depth space using surface normals, then uses the correspondence to
propagate adjacent costs to the reference geometry, followed by a convolution
for aggregation. Our method achieves new state-of-the-art performance on DTU,
Tanks Temple, and ETH3D datasets. Notably, our method ranks 1st on the Tanks
Temple Advanced benchmark.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要