City Research Online

On the Sensory Commutativity of Action Sequences for Embodied Agents

Caselles-Dupré, H., Garcia Ortiz, M. ORCID: 0000-0003-4729-7457 and Filliat, D. (2021). On the Sensory Commutativity of Action Sequences for Embodied Agents. AAMAS '21: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, pp. 1472-1474. doi: 10.5555/3463952.3464129 ISSN 2523-5699

Abstract

Perception of artificial agents is one the grand challenges of AI research. Deep Learning and data-driven approaches are successful on constrained problems where perception can be learned using supervision, but do not scale to open-worlds. In such case, for autonomous embodied agents with first-person sensors, perception can be learned end-to-end to solve particular tasks. However, literature shows that perception is not a purely passive compression mechanism, and that actions play an important role in the formulation of abstract representations. We propose to study perception for these embodied agents, under the mathematical formalism of group theory in order to make the link between perception and action. In particular, we consider the commutative properties of continuous action sequences with respect to sensory information perceived by such an embodied agent. We introduce the Sensory Commutativity Probability (SCP) criterion which measures how much an agent's degree of freedom affects the environment in embodied scenarios. We show how to compute this criterion in different environments, including realistic robotic setups. We empirically illustrate how SCP and the commutative properties of action sequences can be used to learn about objects in the environment and improve sample-efficiency in Reinforcement Learning.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: © the authors, 2021. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in AAMAS '21: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, http://dx.doi.org/10.1145/10.5555/3463952.3464129.
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
Date available in CRO: 02 Jul 2021 09:12
Date deposited: 13 May 2021
Date of acceptance: 18 December 2020
Date of first online publication: 3 May 2021
URI: https://openaccess.city.ac.uk/id/eprint/26141
[img]
Preview
Text - Accepted Version
Download (5MB) | Preview

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login