Physics-model-free heat-electricity energy management of multiple microgrids based on surrogate model-enabled multi-agent deep reinforcement learning

•The proposed control framework mitigates assumptions about accurate physical models.•A novel exploration mechanism incorporates historical information representation.•Each MG controller can manage the energy of MG in a decentralized manner.