An Improved Binary Relevance Algorithm for Multi-Label Classification

Abstract:

Multi-label classification (MLC) is a machine learning task aiming to predict multiple labels for a given instance. The widely known binary relevance (BR) learns one classifier for each label without considering the correlation among labels. In this paper, an improved binary relevance algorithm (IBRAM) is proposed. This algorithm is derived form binary relevance method. It sets two layers to decompose the multi-label classification problem into L independent binary classification problems respectively. In the first layer, binary classifier is built one for each label. In the second layer, the label information from the first layer is fully used to help to generate final predicting by consider the correlation among labels. Experiments on benchmark datasets validate the effectiveness of proposed approach against other well-established methods.

• Periodical: Applied Mechanics and Materials (Volumes 536-537)
• Pages: 394-398
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.536-537.394
• Online since: April 2014
• Authors: Tao Guo*, Gui Yang Li
• Keywords: Binary Relevance, Classifier Chain, Multi-Label Classification, Problem Transformation

References

[1] G. Tsoumakas, L. Katakis, Multi label classification: an overview, International Journal of Data Warehouse and Mining 3 (3) pp.1-13, (2007).

DOI: 10.4018/jdwm.2007070101

[2] Min-Ling Zhang, Kun Zhang, Multi-label learning by exploiting label dependency, KDD 2010: pp.999-1008, (2009).

[3] Li Si-nan, Li Ning, Multi-label Data Mining: A Survey, Computer Science, vol. 40, no. 4, pp.14-21, (2013).

[4] Grigorios Tsoumakas, Min-Ling Zhang, Zhi-Hua Zhou, Introduction to the special issue on learning from multi-label data. Machine Learning, pp: 88: 1-4, (2012).

DOI: 10.1007/s10994-012-5292-9

[5] J. Read, B. Pfahringer, G. Holmes, and E. Frank, Classifier Chains for Multi-Label Classification, Machine Learning, vol. 85, no. 3, p.333–359, (2011).

DOI: 10.1007/s10994-011-5256-5

[6] Tsoumakas, G., Vlahavas, I.P.: Random k-labelsets: An ensemble method for multi-label classification. In: ECML '07: 18th European Conference on Machine Learning, p.406–417. Springer (2007).

DOI: 10.1007/978-3-540-74958-5_38

[7] Eduardo Corrêa Gonçalves, Alexandre Plastino, A Genetic Algorithm for Optimizing the Label Ordering in Multi-Label Classifier Chains, IEEE Congress on Evolutionary Computation. pp.454-461, (2013).

DOI: 10.1109/ictai.2013.76

[8] G. Tsoumakas, E. Spyromitros, J. Vilcek, and I. Vlahavas, Mulan: A Java Library for Multi-Label Learning, Journal of Machine Learning Research, vol. 12, p.2411–2414, (2011).

[9] Min-Ling Zhang, Zhi-Hua Zhou, A Review On Multi-Label Learning Algorithms, IEEE Transactions on Knowledge and Data Engineering, in press, (2013).

[10] G. Madjarov, D. Kocev, D. Gjorgjevikj, and D. Saso, An Extensive Experimental Comparison of Methods for Multi-Label Learning, Pattern Recognition, vol. 45, (2012).

DOI: 10.1016/j.patcog.2012.03.004