A MapReduce architecture for web site user behaviour monitoring in real time

Karakostas, B. & Theodoulidis, B. (2013). A MapReduce architecture for web site user behaviour monitoring in real time. Paper presented at the 2nd International Conference on Data Management Technologies and Applications (DATA), 29 - 31 July 2013, Reykjavik, Iceland.

[img]
Preview
PDF
Download (312kB) | Preview

Abstract

Monitoring the behaviour of large numbers of web site users in real time poses significant performance challenges, due to the decentralised location and volume of generated data. This paper proposes a MapReduce-style architecture where the processing of event series from the Web users is performed by a number of cascading mappers, reducers and rereducers, local to the event origin. With the use of static analysis and a prototype implementation, we show how this architecture is capable to carry out time series analysis in real time for very large web data sets, based on the actual events, instead of resorting to sampling or other extrapolation techniques.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: real time MapReduce, data stream analysis, web log analysis, web mining, Erlang
Subjects: Q Science > QA Mathematics > QA76 Computer software
Divisions: School of Informatics
URI: http://openaccess.city.ac.uk/id/eprint/2251

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics