City Research Online

A MapReduce architecture for web site user behaviour monitoring in real time

Karakostas, B. & Theodoulidis, B. (2013). A MapReduce architecture for web site user behaviour monitoring in real time. Paper presented at the 2nd International Conference on Data Management Technologies and Applications (DATA), 29 - 31 July 2013, Reykjavik, Iceland.


Monitoring the behaviour of large numbers of web site users in real time poses significant performance challenges, due to the decentralised location and volume of generated data. This paper proposes a MapReduce-style architecture where the processing of event series from the Web users is performed by a number of cascading mappers, reducers and rereducers, local to the event origin. With the use of static analysis and a prototype implementation, we show how this architecture is capable to carry out time series analysis in real time for very large web data sets, based on the actual events, instead of resorting to sampling or other extrapolation techniques.

Publication Type: Conference or Workshop Item (Paper)
Publisher Keywords: real time MapReduce, data stream analysis, web log analysis, web mining, Erlang
Subjects: Q Science > QA Mathematics > QA76 Computer software
Departments: School of Science & Technology > Computer Science
[thumbnail of DATA_2013_3.pdf]
Download (312kB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login