Perceiving and predicting expressive rhythm with recurrent neural networks

Lambert, A., Weyde, T. & Armstrong, N. (2015). Perceiving and predicting expressive rhythm with recurrent neural networks. In: Proceedings of the 12th International Conference in Sound and Music Computing. . Maynooth, Ireland: SMC15. ISBN 9780992746629

Text - Published Version
Available under License Creative Commons: Attribution 3.0.

Download (530kB) | Preview


Automatically following rhythms by beat tracking is by no means a solved problem, especially when dealing with varying tempo and expressive timing. This paper presents a connectionist machine learning approach to expressive rhythm prediction, based on cognitive and neurological models. We detail a multi-layered recurrent neural network combining two complementary network models as hidden layers within one system. The first layer is a Gradient Frequency Neural Network (GFNN), a network of nonlinear oscillators which acts as an entraining and learning resonant filter to an audio signal. The GFNN resonances are used as inputs to a second layer, a Long Short-term Memory Recurrent Neural Network (LSTM). The LSTM learns the long-term temporal structures present in the GFNN's output, the metrical structure implicit within it. From these inferences, the LSTM predicts when the next rhythmic event is likely to occur. We train the system on a dataset selected for its expressive timing qualities and evaluate the system on its ability to predict rhythmic events. We show that our GFNN-LSTM model performs as well as state-of-the art beat trackers and has the potential to be used in real-time interactive systems, following and generating expressive rhythmic structures.

Item Type: Book Section
Additional Information: © 2015 Andrew J. Lambert et al.
Subjects: M Music and Books on Music > M Music
Q Science > QA Mathematics > QA76 Computer software
Divisions: School of Arts > Department of Creative Practice & Enterprise - Centre for Music Studies
School of Informatics > Department of Computing

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics