location: Current position: English-homepage >> Scientific Research >> Paper Publications

Emotional Multiagent Reinforcement Learning in Spatial Social Dilemmas

Hits:

Indexed by:Journal Papers

Date of Publication:2015-12-01

Journal:IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS

Included Journals:SCIE、EI、Scopus

Volume:26

Issue:12

Page Number:3083-3096

ISSN No.:2162-237X

Key Words:Cooperation; emotions; multiagent learning; social dilemmas

Abstract:Social dilemmas have attracted extensive interest in the research of multiagent systems in order to study the emergence of cooperative behaviors among selfish agents. Understanding how agents can achieve cooperation in social dilemmas through learning from local experience is a critical problem that has motivated researchers for decades. This paper investigates the possibility of exploiting emotions in agent learning in order to facilitate the emergence of cooperation in social dilemmas. In particular, the spatial version of social dilemmas is considered to study the impact of local interactions on the emergence of cooperation in the whole system. A double-layered emotional multiagent reinforcement learning framework is proposed to endow agents with internal cognitive and emotional capabilities that can drive these agents to learn cooperative behaviors. Experimental results reveal that various network topologies and agent heterogeneities have significant impacts on agent learning behaviors in the proposed framework, and under certain circumstances, high levels of cooperation can be achieved among the agents.

Pre One:Multiagent Learning of Coordination in Loosely Coupled Multiagent Systems

Next One:Structure Identification of Uncertain Complex Networks Based on Anticipatory Projective Synchronization