A Vision-based Remote Assistance Method and It's Application in Object Transfer.

Remote assistance by users is a common means in current robot applications, which can improve the efficiency of transfer tasks. However, the current mainstream methods are costly, relying on auxiliary equipment, and result in a significant workload for users throughout the task. To reduce the cost and workload of remote assistance and improve user interaction with robots. This paper has undertaken the following work using available visual image information. Firstly, proposing a remote guidance method based on facial information, which is derived from analyzing user facial information for gaze estimation and combined with image detection. Secondly, proposing an autonomous transfer method based on position inference, which combines target information in images with the real-time state of the robot. Finally, by integrating the above methods, proposing a vision-based remote assistance method and applyingit in real-world experiments of object transfer tasks.