City Research Online

A MapReduce architecture for web site user behaviour monitoring in real time

Karakostas, B. and Theodoulidis, B. (2013). A MapReduce architecture for web site user behaviour monitoring in real time. Paper presented at the 2nd International Conference on Data Management Technologies and Applications (DATA), 29 - 31 July 2013, Reykjavik, Iceland.

Abstract

Monitoring the behaviour of large numbers of web site users in real time poses significant performance challenges, due to the decentralised location and volume of generated data. This paper proposes a MapReduce-style architecture where the processing of event series from the Web users is performed by a number of cascading mappers, reducers and rereducers, local to the event origin. With the use of static analysis and a prototype implementation, we show how this architecture is capable to carry out time series analysis in real time for very large web data sets, based on the actual events, instead of resorting to sampling or other extrapolation techniques.

Publication Type: Conference or Workshop Item (Paper)
Publisher Keywords: real time MapReduce, data stream analysis, web log analysis, web mining, Erlang
Subjects: Q Science > QA Mathematics > QA76 Computer software
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
URI: http://openaccess.city.ac.uk/id/eprint/2251
[img]
Preview
PDF
Download (312kB) | Preview

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login