Natural interactive control method for unmanned swarm systems based on gesture recognition
2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)(2022)
Abstract
Interactive control is very important for unmanned swarm systems to understand human intentions and execute tasks. However, traditional interactive control usually uses a keyboard, mouse, or remote controller, which is not intuitive and convenient enough. This paper proposes a natural interaction control method based on gesture recognition for unmanned swarm systems. First, considering the real-time requirement of interactive control, the YOLOv5 algorithm is improved by replacing the original GIoU loss function with the DIoU loss function to improve the performance of the algorithm. Then, according to the interactive control requirements of unmanned swarm systems, the corresponding gesture database is established. Finally, the AirSim platform is used to build the simulation system, and the interactive control based on gesture recognition is tested and verified. The experimental results show that the recognition accuracy of the control intention is 97% and the response time is approximately 0.027 s, which can realize the interactive control of unmanned swarm systems.
MoreTranslated text
Key words
unmanned swarm systems,natural interactive control method,gesture recognition,control method
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined