An Optimized Pruning-Based Outlier Detecting Algorithm

Abstract:

An Optimized Pruning-based Outlier Detecting algorithm is proposed based on the density-based outlier detecting algorithm (LOF algorithm). The calculation accuracy and the time complexity of LOF algorithm are not ideal, so two steps are taken to reduce the amount of calculation and improve the calculation accuracy for LOF algorithm. Firstly, using cluster pruning technique to preprocess data set, at the same time filtering the non-outliers based on the differences of cluster models to avoid the error pruning of outliers located at the edge of clusters, different cluster models are output by inputing multiple parameters in the DBSCAN algorithm. Secondly,optimize the query process of the neighborhood (neighbor and k-neighbor). After pruning, local outlier factors are calculated only for the data objects out of clusters. Experimental results show that the algorithm proposed in this paper can improve the outlier detection accuracy, reduce the time complexity and realize the effective local outlier detection.

• Periodical: Applied Mechanics and Materials (Volumes 411-414)
• Pages: 1076-1080
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.411-414.1076
• Online since: September 2013
• Authors: Jing Hua Wang, Xin Xiang Zhao, Peng Jin, Guo Yan Zhang
• Keywords: Clustering, Data Mining (DM), Outlier Detection, Pruning

References

[1] Hawkins D. Identification of Outliers. London: Chapman and Hall, (1980).

[2] Breunig M, Kriegel H P, Ng R, et al. LOF: Identifying Density-based Local Outliers. , 2000[C]. Proc. of the ACM SIGMOD International Conference on Management of Data. [s. 1. ]: ACM press, 2000: 93-104.

DOI: 10.1145/335191.335388

[3] Tang J, Chen Z, Fu A, et al. Enhancin g effectiveness of outlier detections for low-density patterns., In Proceeding of Advances in Knowledge Discovery and Data Mining 6th Pacific Asia Conference, China, (2002).

DOI: 10.1007/3-540-47887-6_53

[4] Weiwei Ni, Geng Chen, Jieping Lu, et al. Local entropy based weighted subspace outlier mining algorithms., Journal of Computer Research Development, 45(2008): 1189-1194, In Chinese.

[5] Anrong Xue, Shiguang Ju, Weihua He, et al. Study on Algorithm for Local Outlier Detection., CHINESE JOURNAL OF COMPUTER, 30(2007): 1456-1463, In Chinese.

[6] Caiping Hu, Xiaolin Qin. A Density Based Local Outlier Detection Algorithm DLOF., Journal of Computer Research Development, 47(2010): 2110-2116, In Chinese.

[7] Ping Gu, Haibo Liu, et al. Multi-clustering based outlier detect algorithm, Application Research of Computers, 30(2013): 751-754, In Chinese.