Performance Enhancement of Deep Reinforcement Learning Networks using Feature Extraction

Ollero, J. & Child, C. H. T. (2018). Performance Enhancement of Deep Reinforcement Learning Networks using Feature Extraction. Paper presented at the 15th International Symposium on Neural Networks, 25-28 Jun 2018, Minsk, Belarus.

[img]
Preview
Text - Accepted Version
Download (706kB) | Preview

Abstract

The combination of Deep Learning and Reinforcement Learning, termed Deep Reinforcement Learning Networks (DRLN), offers the possibility of using a Deep Learning Neural Network to produce an approximate Reinforcement Learning value table that allows extraction of features from neurons in the hidden layers of the network. This paper presents a two stage technique for training a DRLN on features extracted from a DRLN trained on a identical problem, via the implementation of the Q-Learning algorithm, using TensorFlow. The results show that the extraction of features from the hidden layers of the Deep Q-Network improves the learning process of the agent (4.58 times faster and better) and proves the existence of encoded information about the environment which can be used to select the best action. The research contributes preliminary work in an ongoing research project in modeling features extracted from DRLNs.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: The final publication will be available through Springer, https://www.springer.com/gp.
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
URI: http://openaccess.city.ac.uk/id/eprint/19526

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics