Towards Safe Coordination in Multi-agent Systems

Conservative design is the ability of an individual agent to ensure predictability of its overall performance even if some of its actions and interactions may be inherently less predictable or even completely unpredictable. In this paper, we describe the importance of conservative design in cooperative multi-agent systems and briefly characterize the challenges that need to be addressed to achieve this goal.