An Evolutionary Multi-Agent Reinforcement Learning Algorithm for Multi-Uav Air Combat
Knowledge-Based Systems(2024)
摘要
In recent years, multi-agent reinforcement learning (MARL) has been widely used as a multi-UAV autonomous countermeasure. However, because training is usually performed in a self-play manner, the existing algorithms may suffer from strategic cycles without progress. Moreover, in complex air combat, the state dimensions change dynamically with the varying number of unmanned aerial vehicles (UAVs), making it difficult for existing MARL algorithms with fixed-input-size network architectures to effectively handle the variations. Therefore, we propose an evolutionary MARL method that can avoid cycles through the evolution of a population of UAV groups. In addition, an attention mechanism with death masking was adopted to handle dynamic changes in the number of UAVs. Experimental results conducted in our constructed multi-UAV air combat environment show that our method outperforms state-of-the-art methods and can help UAVs generate effective maneuver strategies to defeat opponents.
更多查看译文
关键词
Multi-UAV combat,Multi-agent reinforcement learning,Evolutionary algorithm,Attention mechanism
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要