Fine-grained similarity semantic preserving deep hashing for cross-modal retrieval

Guoyou Li,Qingjun Peng,Dexu Zou, Jinyue Yang,Zhenqiu Shu

FRONTIERS IN PHYSICS(2023)

Cited 0|Views2
No score
Abstract
Cross-modal hashing methods have received wide attention in cross-modal retrieval owing to their advantages in computational efficiency and storage cost. However, most existing deep cross-modal hashing methods cannot employ both intra-modal and inter-modal similarities to guide the learning of hash codes and ignore the quantization loss of hash codes, simultaneously. To solve the above problems, we propose a fine-grained similarity semantic preserving deep hashing (FSSPDH) for cross-modal retrieval. Firstly, this proposed method learns different hash codes for different modalities to preserve the intrinsic property of each modality. Secondly, the fine-grained similarity matrix is constructed by using labels and data features, which not only maintains the similarity between and within modalities. In addition, quantization loss is used to learn hash codes and thus effectively reduce information loss caused during the quantization procedure. A large number of experiments on three public datasets demonstrate the advantage of the proposed FSSPDH method.
More
Translated text
Key words
cross-modal fusion,similarity semantic preserving,quantization loss,deep hashing,intra-modal similarity,inter-modal similarity,fine-grained similarity
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined