Natural interactive control method for unmanned swarm systems based on gesture recognition

Interactive control is very important for unmanned swarm systems to understand human intentions and execute tasks. However, traditional interactive control usually uses a keyboard, mouse, or remote controller, which is not intuitive and convenient enough. This paper proposes a natural interaction control method based on gesture recognition for unmanned swarm systems. First, considering the real-time requirement of interactive control, the YOLOv5 algorithm is improved by replacing the original GIoU loss function with the DIoU loss function to improve the performance of the algorithm. Then, according to the interactive control requirements of unmanned swarm systems, the corresponding gesture database is established. Finally, the AirSim platform is used to build the simulation system, and the interactive control based on gesture recognition is tested and verified. The experimental results show that the recognition accuracy of the control intention is 97% and the response time is approximately 0.027 s, which can realize the interactive control of unmanned swarm systems.