Unsupervised Collaborative Metric Learning with Mixed-Scale Groups for General Object Retrieval
CoRR(2024)
摘要
The task of searching for visual objects in a large image dataset is
difficult because it requires efficient matching and accurate localization of
objects that can vary in size. Although the segment anything model (SAM) offers
a potential solution for extracting object spatial context, learning embeddings
for local objects remains a challenging problem. This paper presents a novel
unsupervised deep metric learning approach, termed unsupervised collaborative
metric learning with mixed-scale groups (MS-UGCML), devised to learn embeddings
for objects of varying scales. Following this, a benchmark of challenges is
assembled by utilizing COCO 2017 and VOC 2007 datasets to facilitate the
training and evaluation of general object retrieval models. Finally, we conduct
comprehensive ablation studies and discuss the complexities faced within the
domain of general object retrieval. Our object retrieval evaluations span a
range of datasets, including BelgaLogos, Visual Genome, LVIS, in addition to a
challenging evaluation set that we have individually assembled for
open-vocabulary evaluation. These comprehensive evaluations effectively
highlight the robustness of our unsupervised MS-UGCML approach, with an object
level and image level mAPs improvement of up to 6.69
The code is publicly available at https://github.com/dengyuhai/MS-UGCML.
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要