A MapReduce architecture for web site user behaviour monitoring in real time
Karakostas, B. & Theodoulidis, B. (2013). A MapReduce architecture for web site user behaviour monitoring in real time. Paper presented at the 2nd International Conference on Data Management Technologies and Applications (DATA), 29 - 31 July 2013, Reykjavik, Iceland.
Abstract
Monitoring the behaviour of large numbers of web site users in real time poses significant performance challenges, due to the decentralised location and volume of generated data. This paper proposes a MapReduce-style architecture where the processing of event series from the Web users is performed by a number of cascading mappers, reducers and rereducers, local to the event origin. With the use of static analysis and a prototype implementation, we show how this architecture is capable to carry out time series analysis in real time for very large web data sets, based on the actual events, instead of resorting to sampling or other extrapolation techniques.
| Publication Type: | Conference or Workshop Item (Paper) |
|---|---|
| Publisher Keywords: | real time MapReduce, data stream analysis, web log analysis, web mining, Erlang |
| Subjects: | Q Science > QA Mathematics > QA76 Computer software |
| Departments: | School of Science & Technology > Computer Science |
Download (312kB) | Preview
Export
Downloads
Downloads per month over past year
Metadata
MetadataActions (login required)
Admin Login