Lecture Notes in Computer Science vol: 4065 pages:121-130
6th Industrial Conference on Data Mining (ICDM 2006) location:lnai, Leipzig (Germany) date:Jul. 14-15
This paper describes part of a web usage mining study executed on log files obtained from a Belgian e-commerce company. From these log files, it can be observed that numerous web robots are active on the site. Most of these robots show a crawling behavior that is radically different from the browsing behavior of human visitors. Because the owners of the e-shop desire information about the paths that human visitors follow through the site, it is of crucial importance to remove these robotic visits from the log files.