City Research Online

Learning music similarity from relative user ratings

Wolff, D. & Weyde, T. (2013). Learning music similarity from relative user ratings. Information Retrieval, 17(2), pp. 109-136. doi: 10.1007/s10791-013-9229-0


Computational modelling of music similarity is an increasingly important part of personalisation and optimisation in music information retrieval and research in music perception and cognition. The use of relative similarity ratings is a new and promising approach to modelling similarity that avoids well known problems with absolute ratings. In this article, we use relative ratings from the MagnaTagATune dataset with new and existing variants of state-of-the-art algorithms and provide the first comprehensive and rigorous evaluation of this approach. We compare metric learning based on support vector machines (SVMs) and metric-learning-to-rank (MLR), including a diagonal and a novel weighted variant, and relative distance learning with neural networks (RDNN). We further evaluate the effectiveness of different high and low level audio features and genre data, as well as dimensionality reduction methods, weighting of similarity ratings, and different sampling methods. Our results show that music similarity measures learnt on relative ratings can be significantly better than a standard Euclidian metric, depending on the choice of learning algorithm, feature sets and application scenario. MLR and SVM outperform DMLR and RDNN, while MLR with weighted ratings leads to no further performance gain. Timbral and music-structural features are most effective, and all features jointly are significantly better than any other combination of feature sets. Sharing audio clips (but not the similarity ratings) between test and training sets improves performance, in particular for the SVM-based methods, which is useful for some applications scenarios. A testing framework has been implemented in Matlab and made publicly available so that these results are reproducible.

Publication Type: Article
Additional Information: The final publication is available at Springer via
Publisher Keywords: Music Similarity, Relative Similarity Ratings, Metric Learning, Support Vector Machines, Metric Learning to Rank, Neural Networks
Subjects: M Music and Books on Music > M Music
Z Bibliography. Library Science. Information Resources > Z665 Library Science. Information Science
Departments: School of Science & Technology > Computer Science
PDF - Accepted Version
Download (582kB) | Preview



Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login