BiFA: Remote Sensing Image Change Detection With Bitemporal Feature Alignment
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING(2024)
Abstract
Despite the success of deep learning-based change detection (CD) methods, their existing insufficiency in temporal (channel and spatial) and multiscale alignment has rendered them insufficient capability in mitigating external factors (illumination changes and perspective differences) arising from different imaging conditions during CD. In this article, a bitemporal feature alignment (BiFA) model is proposed to produce a precise CD map in a lightweight manner by reducing the impact of irrelevant factors. Specifically, for the temporal alignment, the bitemporal interaction (BI) module is proposed to realize the alignment of the bitemporal image channel level. Our intuition is introducing the BI in the feature extraction stage may benefit suppressing the interference, such as illumination changes. Simultaneously, the alignment module based on differential flow field (ADFF) is proposed to explicitly estimate the offset of the bitemporal image and realize their spatial level alignment to mitigate the inadequate registration resulting from different perspectives. Furthermore, for the multiscale alignment, we introduce the implicit neural alignment decoder (IND) to produce more refined prediction maps achieving precise alignment of multiscale features by learning continuous image representations in coordinate space. Our BiFA outperforms other state-of-the-art methods on six datasets (such as the F1-score (F1)/intersection over union (IoU) scores are improved by 2.70%/3.91% and 2.01%/2.94% on Learning, VIsion, and Remote sensing (LEVIR)+-CD and Sun Yat-sen University (SYSU)-CD, respectively) and displays greater robustness in cross-resolution CD. Our code is available at https://github.com/zmoka-zht/BiFA.
MoreTranslated text
Key words
Feature extraction,Task analysis,Remote sensing,Transformers,Interference,Decoding,Optical flow,Bitemporal interaction (BI),change detection (CD),feature alignment,flow field,high-resolution optical remote sensing image,implicit neural representation
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined