SeaDSC: A video-based unsupervised method for dynamic scene change detection in unmanned surface vehicles
2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)(2023)
摘要
Recently, there has been an upsurge in the research on maritime vision, where
a lot of works are influenced by the application of computer vision for
Unmanned Surface Vehicles (USVs). Various sensor modalities such as camera,
radar, and lidar have been used to perform tasks such as object detection,
segmentation, object tracking, and motion planning. A large subset of this
research is focused on the video analysis, since most of the current vessel
fleets contain the camera's onboard for various surveillance tasks. Due to the
vast abundance of the video data, video scene change detection is an initial
and crucial stage for scene understanding of USVs. This paper outlines our
approach to detect dynamic scene changes in USVs. To the best of our
understanding, this work represents the first investigation of scene change
detection in the maritime vision application. Our objective is to identify
significant changes in the dynamic scenes of maritime video data, particularly
those scenes that exhibit a high degree of resemblance. In our system for
dynamic scene change detection, we propose completely unsupervised learning
method. In contrast to earlier studies, we utilize a modified cutting-edge
generative picture model called VQ-VAE-2 to train on multiple marine datasets,
aiming to enhance the feature extraction. Next, we introduce our innovative
similarity scoring technique for directly calculating the level of similarity
in a sequence of consecutive frames by utilizing grid calculation on retrieved
features. The experiments were conducted using a nautical video dataset called
RoboWhaler to showcase the efficient performance of our technique.
更多查看译文
关键词
Detection Methods,Dynamic Changes,Change Detection,Dynamic Scenes,Scene Changes,Change Detection Methods,Autonomous Surface Vehicles,Scene Change Detection,Computer Vision,Unsupervised Learning,Similarity Score,Object Detection,Video Analysis,Path Planning,Video Data,Consecutive Frames,Object Tracking,Computer Vision Applications,Video Scenes,Histogram,Pair Of Frames,Video Compression,Video Frames,Distinct Vectors,Grid Cells,Vector Quantization,Feature Maps,Model Projections,Deep Learning,Convolutional Neural Network
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要