Towards Robust Tropical Cyclone Wind Radii Estimation with Multi-Modality Fusion and Missing-Modality Distillation
IEEE Transactions on Geoscience and Remote Sensing(2024)
Abstract
Accurate and timely estimation of tropical cyclone (TC) wind radii is significant for characterizing wind structure, disaster prevention and mitigation, etc. The existing methods have not sufficiently considered and utilized multi-modal (i.e., multi-source heterogeneous) data for wind radii estimation. Meanwhile, complete modalities (i.e., all used modalities) can hardly be available simultaneously, especially in real-time monitoring scenarios, which restricts the applicability of multi-modal estimation models. It is challenging to maintain the accuracy of wind radii estimates when confronted with the issue of missing-modality. Therefore, to address these issues, this paper aims to achieve robust TC wind radii estimation under both conditions with complete modalities and missing-modality. We first present a multi-modal fusion network, MT-TCNet, for estimating TC wind radii under conditions with complete modalities. MT-TCNet benefits from multi-modal data including satellite infrared images, reanalysis wind fields, and the physical parameter maximum sustained wind speed (MSW). MSW, which reflects TC intensity, is incorporated to embed the implicit relationship between TC intensity and wind radii. It is capable of providing superior and robust wind radii estimates in scenarios without time constraints, and can be used to generate long-term historical results. Furthermore, this paper proposes MT-TCNet-Distill to alleviate the issue of missing-modality caused by delays in ERA5 reanalysis wind fields through generalized distillation and missing modality imputation. MT-TCNet-Distill broadens the applicability of MT-TCNet, which heavily relies on reanalysis data, enabling robust wind radii estimation in real-time scenarios. Comprehensive experiments demonstrate the superior performance of MT-TCNet and MT-TCNet-Distill compared to state-of-the-art methods.
MoreTranslated text
Key words
Tropical cyclone,wind radii estimation,multi-modal,data fusion,missing-modality,knowledge distillation
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined