A Universal Knowledge Embedded Contrastive Learning Framework for Hyperspectral Image Classification
CoRR(2024)
Abstract
Hyperspectral image (HSI) classification techniques have been intensively
studied and a variety of models have been developed. However, these HSI
classification models are confined to pocket models and unrealistic ways of
datasets partitioning. The former limits the generalization performance of the
model and the latter is partitioned leads to inflated model evaluation metrics,
which results in plummeting model performance in the real world. Therefore, we
propose a universal knowledge embedded contrastive learning framework (KnowCL)
for supervised, unsupervised, and semisupervised HSI classification, which
largely closes the gap of HSI classification models between pocket models and
standard vision backbones. We present a new HSI processing pipeline in
conjunction with a range of data transformation and augmentation techniques
that provide diverse data representations and realistic data partitioning. The
proposed framework based on this pipeline is compatible with all kinds of
backbones and can fully exploit labeled and unlabeled samples with expected
training time. Furthermore, we design a new loss function, which can adaptively
fuse the supervised loss and unsupervised loss, enhancing the learning
performance. This proposed new classification paradigm shows great potentials
in exploring for HSI classification technology. The code can be accessed at
https://github.com/quanweiliu/KnowCL.
MoreTranslated text
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined