Document Type

Journal Article

Faculty

Faculty of Computing, Health and Science

School

School of Computer and Security Science

RAS ID

12529

Comments

This article was originally published as: Leng, J. , & Lim, C. (2011). Reinforcement learning of competitive and cooperative skills in soccer agents. Applied Soft Computing , 11(1), 1353-1362. Original article available here

Abstract

The main aim of this paper is to provide a comprehensive numerical analysis on the efficiency of various reinforcementlearning (RL) techniques in an agent-based soccer game. The SoccerBots is employed as a simulation testbed to analyze the effectiveness of RL techniques under various scenarios. A hybrid agent teaming framework for investigating agent team architecture, learning abilities, and other specific behaviours is presented. Novel RL algorithms to verify the competitiveandcooperativelearning abilities of goal-oriented agents for decision-making are developed. In particular, the tile coding (TC) technique, a function approximation approach, is used to prevent the state space from growing exponentially, hence avoiding the curse of dimensionality. The underlying mechanism of eligibility traces is evaluated in terms of on-policy and off-policy procedures, as well as accumulating traces and replacing traces. The results obtained are analyzed, and implications of the results towards agent teaming and learning are discussed.

DOI

10.1016/j.asoc.2010.04.007

Access Rights

free_to_read

 
COinS
 

Link to publisher version (DOI)

10.1016/j.asoc.2010.04.007