City Research Online

Performance Enhancement of Deep Reinforcement Learning Networks using Feature Extraction

Ollero, J. and Child, C. H. T. (2018). Performance Enhancement of Deep Reinforcement Learning Networks using Feature Extraction. Paper presented at the 15th International Symposium on Neural Networks, 25-28 Jun 2018, Minsk, Belarus.


The combination of Deep Learning and Reinforcement Learning, termed Deep Reinforcement Learning Networks (DRLN), offers the possibility of using a Deep Learning Neural Network to produce an approximate Reinforcement Learning value table that allows extraction of features from neurons in the hidden layers of the network. This paper presents a two stage technique for training a DRLN on features extracted from a DRLN trained on a identical problem, via the implementation of the Q-Learning algorithm, using TensorFlow. The results show that the extraction of features from the hidden layers of the Deep Q-Network improves the learning process of the agent (4.58 times faster and better) and proves the existence of encoded information about the environment which can be used to select the best action. The research contributes preliminary work in an ongoing research project in modeling features extracted from DRLNs.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: The final publication will be available through Springer,
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
Text - Accepted Version
Download (706kB) | Preview



Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login