An Improved Internal Model for Swarm Formation and Adaptive Swarm Behavior Acquisition

To form a swarm and acquire swarm behaviors adaptive to the environment, we proposed a neuro-fuzzy learning system as a common internal model of each individual recently. The proposed swarm behavior learning system showed its efficient accomplishment in the simulation experiments of goal-exploration problems. However, the input information observed from the environment in our conventional methods was given by coordinate spaces (discrete or continuous) which were difficult to be obtained in the real world by the individuals. This paper intends to improve our previous neuro-fuzzy learning system to deal with the local-limited observation, i.e., usually being a Partially Observable Markov Decision Process (POMDP), by adopting eligibility traces and balancing trade-off between exploration and exploitation to the conventional learning algorithm. Simulations of goal-oriented problems for swarm learning were executed and the results showed the effectiveness of the improved learning system.