City Research Online

Event-based media processing and analysis: A survey of the literature

Tzelepis, C. ORCID: 0000-0002-2036-9089, Ma, Z., Mezaris, V. , Ionescu, B., Kompatsiaris, I., Boato, G., Sebe, N. & Yan, S. (2016). Event-based media processing and analysis: A survey of the literature. Image and Vision Computing, 53, pp. 3-19. doi: 10.1016/j.imavis.2016.05.005


Research on event-based processing and analysis of media is receiving an increasing attention from the scientific community due to its relevance for an abundance of applications, from consumer video management and video surveillance to lifelogging and social media. Events have the ability to semantically encode relationships of different informational modalities, such as visual–audio–text, time, involved agents and objects, with the spatio-temporal component of events being a key feature for contextual analysis. This unveils an enormous potential for exploiting new information sources and opening new research directions. In this paper, we survey the existing literature in this field. We extensively review the employed conceptualization of the notion of event in multimedia, the techniques for event representation and modeling, the feature representation and event inference approaches for the problems of event detection in audio, visual, and textual content. Furthermore, we review some key event-based multimedia applications, and various benchmarking activities that provide solid frameworks for measuring the performance of different event processing and analysis systems. We provide an in-depth discussion of the insights obtained from reviewing the literature and identify future directions and challenges.

Publication Type: Article
Additional Information: © 2016. This manuscript version is made available under the CC-BY-NC-ND 4.0 license in new tab/window)
Publisher Keywords: Event-based media processing and analysis, Event conceptualization, Event representation and modeling, Multimedia event detection, Event-based applications and benchmarking, Survey of the literature
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Science & Technology
School of Science & Technology > Computer Science
SWORD Depositor:
[thumbnail of tzelepis_imavis_survey_event.pdf]
Text - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (790kB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login