Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation

Daniel Polani; Marcus Clements

doi:10.1007/978-3-319-66471-2_5

Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation

Daniel Polani, Marcus Clements

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

38 Downloads (Pure)

Abstract

Players in team sports cooperate in a coordinated manner to achieve common goals. Automated players in academic and commercial team sports simulations have tradi- tionally been driven by complex externally motivated value functions with heuristics based on knowledge of game tactics and strategy. Empowerment is an information-theoretic mea- sure of an agent’s potential to influence its environment, which has been shown to provide a useful intrinsic value function, without the need for external goals and motivation, for agents in single agent models. In this paper we expand on the concept of empowerment to propose the concept of team empowerment as an intrinsic, generic utility function for coop- erating agents. We show that agents motivated by team empowerment exhibit recognizable team behaviors in a simple team sports simulation based on Ultimate Frisbee.

Original language	English
Title of host publication	Interactive Collaborative Robotics
Subtitle of host publication	Second International Conference, ICR 2017, Hatfield, UK, September 12-16, 2017, Proceedings
Publisher	Springer Nature Link
Pages	37-49
Number of pages	13
ISBN (Electronic)	9783319664712
ISBN (Print)	9783319664705
DOIs	https://doi.org/10.1007/978-3-319-66471-2_5
Publication status	E-pub ahead of print - 11 Aug 2017
Event	19th International Conference on Speech and Computer SPECOM 2017 - The University of Hertfordshire, Hatfield, United Kingdom Duration: 12 Sept 2017 → 16 Sept 2017 http://specom.nw.ru/

Conference

Conference	19th International Conference on Speech and Computer SPECOM 2017
Abbreviated title	SPECOM 2017
Country/Territory	United Kingdom
City	Hatfield
Period	12/09/17 → 16/09/17
Internet address	http://specom.nw.ru/

Access to Document

10.1007/978-3-319-66471-2_5

146_clements_polani_team_empowerment
© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of a paper published in Interactive Collaborative Robotics, Second International Conference, ICR 2017, Hatfield, UK, September 12-16, 2017, Proceedings. The final authenticated version is available online at: https://doi.org/10.1007/978-3-319-66471-2_5
Accepted author manuscript, 352 KBLicence: Unspecified

Cite this

@inproceedings{cadab5c5d487474a954bb7f36a5d76ec,

title = "Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation",

abstract = "Players in team sports cooperate in a coordinated manner to achieve common goals. Automated players in academic and commercial team sports simulations have tradi- tionally been driven by complex externally motivated value functions with heuristics based on knowledge of game tactics and strategy. Empowerment is an information-theoretic mea- sure of an agent{\textquoteright}s potential to influence its environment, which has been shown to provide a useful intrinsic value function, without the need for external goals and motivation, for agents in single agent models. In this paper we expand on the concept of empowerment to propose the concept of team empowerment as an intrinsic, generic utility function for coop- erating agents. We show that agents motivated by team empowerment exhibit recognizable team behaviors in a simple team sports simulation based on Ultimate Frisbee.",

author = "Daniel Polani and Marcus Clements",

note = "{\textcopyright} 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of a paper published in Interactive Collaborative Robotics, Second International Conference, ICR 2017, Hatfield, UK, September 12-16, 2017, Proceedings. The final authenticated version is available online at: https://doi.org/10.1007/978-3-319-66471-2_5; 19th International Conference on Speech and Computer SPECOM 2017, SPECOM 2017 ; Conference date: 12-09-2017 Through 16-09-2017",

year = "2017",

month = aug,

day = "11",

doi = "10.1007/978-3-319-66471-2_5",

language = "English",

isbn = "9783319664705",

pages = "37--49",

booktitle = "Interactive Collaborative Robotics",

publisher = "Springer Nature Link",

address = "Netherlands",

url = "http://specom.nw.ru/",

}

Polani, D & Clements, M 2017, Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation. in Interactive Collaborative Robotics: Second International Conference, ICR 2017, Hatfield, UK, September 12-16, 2017, Proceedings. Springer Nature Link, pp. 37-49, 19th International Conference on Speech and Computer SPECOM 2017, Hatfield, United Kingdom, 12/09/17. https://doi.org/10.1007/978-3-319-66471-2_5

Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation. / Polani, Daniel; Clements, Marcus.
Interactive Collaborative Robotics: Second International Conference, ICR 2017, Hatfield, UK, September 12-16, 2017, Proceedings. Springer Nature Link, 2017. p. 37-49.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation

AU - Polani, Daniel

AU - Clements, Marcus

N1 - © 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of a paper published in Interactive Collaborative Robotics, Second International Conference, ICR 2017, Hatfield, UK, September 12-16, 2017, Proceedings. The final authenticated version is available online at: https://doi.org/10.1007/978-3-319-66471-2_5

PY - 2017/8/11

Y1 - 2017/8/11

N2 - Players in team sports cooperate in a coordinated manner to achieve common goals. Automated players in academic and commercial team sports simulations have tradi- tionally been driven by complex externally motivated value functions with heuristics based on knowledge of game tactics and strategy. Empowerment is an information-theoretic mea- sure of an agent’s potential to influence its environment, which has been shown to provide a useful intrinsic value function, without the need for external goals and motivation, for agents in single agent models. In this paper we expand on the concept of empowerment to propose the concept of team empowerment as an intrinsic, generic utility function for coop- erating agents. We show that agents motivated by team empowerment exhibit recognizable team behaviors in a simple team sports simulation based on Ultimate Frisbee.

AB - Players in team sports cooperate in a coordinated manner to achieve common goals. Automated players in academic and commercial team sports simulations have tradi- tionally been driven by complex externally motivated value functions with heuristics based on knowledge of game tactics and strategy. Empowerment is an information-theoretic mea- sure of an agent’s potential to influence its environment, which has been shown to provide a useful intrinsic value function, without the need for external goals and motivation, for agents in single agent models. In this paper we expand on the concept of empowerment to propose the concept of team empowerment as an intrinsic, generic utility function for coop- erating agents. We show that agents motivated by team empowerment exhibit recognizable team behaviors in a simple team sports simulation based on Ultimate Frisbee.

U2 - 10.1007/978-3-319-66471-2_5

DO - 10.1007/978-3-319-66471-2_5

M3 - Conference contribution

SN - 9783319664705

SP - 37

EP - 49

BT - Interactive Collaborative Robotics

PB - Springer Nature Link

T2 - 19th International Conference on Speech and Computer SPECOM 2017

Y2 - 12 September 2017 through 16 September 2017

ER -

Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation

Abstract

Conference

Access to Document

Fingerprint

Cite this