A Multimodal Handover Failure Detection Dataset and Baselines
CoRR(2024)
摘要
An object handover between a robot and a human is a coordinated action which
is prone to failure for reasons such as miscommunication, incorrect actions and
unexpected object properties. Existing works on handover failure detection and
prevention focus on preventing failures due to object slip or external
disturbances. However, there is a lack of datasets and evaluation methods that
consider unpreventable failures caused by the human participant. To address
this deficit, we present the multimodal Handover Failure Detection dataset,
which consists of failures induced by the human participant, such as ignoring
the robot or not releasing the object. We also present two baseline methods for
handover failure detection: (i) a video classification method using 3D CNNs and
(ii) a temporal action segmentation approach which jointly classifies the human
action, robot action and overall outcome of the action. The results show that
video is an important modality, but using force-torque data and gripper
position help improve failure detection and action segmentation accuracy.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要