A Multi-Label Classification Using KNN and FP-Growth Techniques

Abstract:

In this paper we propose a new approach combines KNN method with FP-growth algorithm for identification and modeling existing dependencies between labels (ML-FKNN). We define and develop an algorithm that, first, utilize FP-growth algorithm for generating the association rules to identifies dependencies among the labels, then divides the whole train set into several mutually exclusive subsets to calculate the mean vectors of the each subset, and selects K nearest label neighbors for test instance by calculating its similarity with the mean vectors of the training subsets , and finally identifies the final predicted label set incorporating the discovered dependencies. Empirical evaluations on benchmark datasets shows that the proposed approach achieves high and stable accuracy results and is competitive with some existing methods for multi-label classification.

• Periodical: Advanced Materials Research (Volumes 791-793)
• Pages: 1554-1557
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.791-793.1554
• Online since: September 2013
• Authors: Jia Li Mao, Ming Dong Li, Min Liu
• Keywords: Association Rule, KNN, Multi-Label Classification

References

[1] Shantanu Godbole and Sunita Sarawagi, Discriminative methods for multi-labeled classification, " In PAKDD , 04: 8th Pacific-Asia Conference on Knowledge Discovery and Data Mining, p.22–30. Springer, (2004).

DOI: 10.1007/978-3-540-24775-3_5

[2] Tsoumakas G, Katakis I, Multi-label classification: An overview, International Journal of Data Warehousing and Mining, pp.1-13, 2007, 3(3).

DOI: 10.4018/jdwm.2007070101

[3] M.L. Zhang, Z.H. Zhou, ML-kNN: A lazy learning approach to multi-label learning, Pattern Recognition , pp.2038-2007, 40(7).

DOI: 10.1016/j.patcog.2006.12.019

[4] Spyromitros E, Tsoumakas G, and Vlahavas I, An empirical studyof lazy multilabel classification algorithms, " In SETN , 08: Fifth Hellenicconference on Artificial Intelligence, pp.401-406, Berlin, Heidelberg. Springer. (2008).

DOI: 10.1007/978-3-540-87881-0_40

[5] Junming Xu, Yuan Jiang, Zhihua Zhou, Bayesian Classifier Based on Frequent Item Sets Mining, Journal of Computer Research and Development, pp.1293-1300, 2007, 44(8).

DOI: 10.1360/crad20070803

[6] Xiaoyong LV , Hongbo SHI, Multi-label Text Classification Algorithm Based on Frequent Item Sets, Computer Engineering, pp.83-85, 2010, 36(15).

[7] A. Elisseeff and J. Weston, A kernel method for multi-labeled classification, Proceedings of Advances in Neural Information Processing Systems, Canada: Vancouver, VOI. 14, pp.681-687, Dec. (2003).