University of Hertfordshire

From the same journal

By the same authors

Goal-directed Empowerment: combining Intrinsic Motivation and Task-oriented Behaviour

Research output: Contribution to journalArticlepeer-review

Documents

  • GDE_final

    Accepted author manuscript, 3.78 MB, PDF document

View graph of relations
Original languageEnglish
Number of pages12
JournalIEEE Transactions on Cognitive and Developmental Systems
Early online date7 Dec 2020
DOIs
Publication statusE-pub ahead of print - 7 Dec 2020

Abstract

Empowerment is an information-theoretic measure representing the capacity of an agent to affect its environment. It quantifies its ability to inject information in the environment via its actions and to recapture this information through its sensors. In a nutshell, it measures the number of future options available and perceivable by the agent. Originally, the definition of empowerment does not depend on any particular extrinsic goal and it is determined only by the interaction of the agent with the world and the structure of its action-perception cycle.
In this paper we introduce a new formalism that combines empowerment maximization with externally specifiable goal-directed behaviour. This has two main implications: on the one hand, the study of the relationship between empowerment optimization and goal-directedness, to investigate to which extent these two desirable behaviours can co-exist; on the other hand, from a more operational point of view, the derivation of a method to generate a behaviour (i.e., a policy of a Markov decision process) that is both empowered and goal-directed, in order to design agents capable of being as "empowered" as possible when facing any extrinsic task. Finally, we study how this hybrid policy is able to handle problems of uncertain or changing goals and delayed goal commitment.

Notes

© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

ID: 22760750