Conference Proceeding Article
Anomaly or outlier detection has a wide range of applications, including fraud and spam detection. Most existing studies focus on detecting point anomalies, i.e., individual, isolated entities. However, there is an increasing number of applications in which anomalies do not occur individually, but in small collections. Unlike the majority, entities in an anomalous collection tend to share certain extreme behavioral traits. The knowledge essential in understanding why and how the set of entities becomes outliers would only be revealed by examining at the collection level. A good example is web spammers adopting common spamming techniques. To discover this kind of anomalous collections, we introduce a novel definition of anomaly, called Extreme Rank Anomalous Collection. We propose a statistical model to quantify the anomalousness of such a collection, and present an exact as well as a heuristic algorithms for finding top-K extreme rank anomalous collections. We apply the algorithms on real Web spam data to detect spamming sites, and on IMDB data to detect unusual actor groups. Our algorithms achieve higher precisions compared to existing spam and anomaly detection methods. More importantly, our approach succeeds in finding meaningful anomalous collections in both datasets.
Computer Sciences | Databases and Information Systems
Data Management and Analytics
12th SIAM International Conference on Data Mining 2012: Anaheim, California, 26-28 April 2012
City or Country
DAI, Hanbo; ZHU, Feida; LIM, Ee-Peng; and PANG, Hwee Hwa.
Detecting Extreme Rank Anomalous Collections. (2012). 12th SIAM International Conference on Data Mining 2012: Anaheim, California, 26-28 April 2012. 883-894. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/2870
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.