Gyro-based Neural Single Image Deblurring
arxiv(2024)
摘要
In this paper, we present GyroDeblurNet, a novel single image deblurring
method that utilizes a gyro sensor to effectively resolve the ill-posedness of
image deblurring. The gyro sensor provides valuable information about camera
motion during exposure time that can significantly improve deblurring quality.
However, effectively exploiting real-world gyro data is challenging due to
significant errors from various sources including sensor noise, the disparity
between the positions of a camera module and a gyro sensor, the absence of
translational motion information, and moving objects whose motions cannot be
captured by a gyro sensor. To handle gyro error, GyroDeblurNet is equipped with
two novel neural network blocks: a gyro refinement block and a gyro deblurring
block. The gyro refinement block refines the error-ridden gyro data using the
blur information from the input image. On the other hand, the gyro deblurring
block removes blur from the input image using the refined gyro data and further
compensates for gyro error by leveraging the blur information from the input
image. For training a neural network with erroneous gyro data, we propose a
training strategy based on the curriculum learning. We also introduce a novel
gyro data embedding scheme to represent real-world intricate camera shakes.
Finally, we present a synthetic dataset and a real dataset for the training and
evaluation of gyro-based single image deblurring. Our experiments demonstrate
that our approach achieves state-of-the-art deblurring quality by effectively
utilizing erroneous gyro data.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要