Semi-Supervised Learning for Classification with Uncertainty

Abstract:

Support vector machine (SVM) is a general and powerful learning machine, which adopts supervised manner. However, for many practical machine learning and data mining applications, unlabeled training examples are readily available but labeled ones are very expensive to be obtained. Therefore, semi-supervised learning emerges as the times require. At present, the combination of SVM and semi-supervised learning (S3VM) has attracted more and more attentions. In general, S3VM deals with problems with small training sets and large working sets. When the training set is large relative to the working set, We propose a new SVM model to solve the above classification problem by introducing the fuzzy memberships to each unlabeled point. Simulation results demonstrate that the proposed method can exploit unlabeled data to yield good performance effectively.

• Periodical: Advanced Materials Research (Volumes 433-440)
• Pages: 3584-3590
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.433-440.3584
• Online since: January 2012
• Authors: Rui Zhang, Tong Bo Liu, Ming Wen Zheng
• Keywords: Classification, S³VM, Support Vector Machine (SVM)

References

[1] Amini, M. , and Gallinari, P. (2003). Semi–supervised learning with an explicit label-error model for misclassified data. IJCAI2003.

[2] Balcan, M. , Blum, A. , Choi, P. , Lafferty, J. , Pantano, B. Rwebangira, M. , and Zhu, X. (2005).

[3] Baluja, S. (1998). Probabilistic modeling for face orientation discrimination: Learning from labeled and unlabeled data. Neural Information Processing Systems (NIPS).

[4] Blum, A. , and Mitchell, T. (1998). Combining labeled and unlabeled data with co-training. Proceedings of the 11th Annual Conference on Computational Learning Theory.

DOI: 10.1145/279943.279962

[5] Joachims, T. (1999). Transductive inference for text classification using support vector machines. ICML1999, 200–209.

[6] Vapnik, V. (1998). Statistical Learning Theory. Wiley, New York.

[7] Bennett, K. and Demiriz, A. (1998). Semi–Supervised Support Vector Machines. In Advances in Neural Information Processing Systems, 12, 368-374.

[8] Fung, G. , & Mangasarian, O. (2001). Semi-supervised support vector machines for unlabeled data classification. Optimization Methods and Software, 29C44.

DOI: 10.1080/10556780108805809

[9] C. Cortes and V.N. Vapnik. Support vector networks. Machine learning, 20: 273-297, (1995).

DOI: 10.1007/bf00994018

[10] V.N. Vapnik. The nature of Statistical Learning Theory. Springer Verlag, New York, (1995).

[11] A.M. Bensaid L.O. hall,J. c. Bezdek, and L.P. Clarke. Partially supervised clustering for image segmentation. Pattern Recognition, 29(5): 859- 871, (1998).

DOI: 10.1016/0031-3203(95)00120-4

[12] M. Vaidyanathan R.P. Velthuizen,P. Venugopal L.P. Clarke, and L.O. Hall. Tumor volume measurements using supervised and semisupervised mri segmentation. In Artificial Neural Networks in Engineering Conference, ANNIE(1994), (1994).

[13] J. Mill, A. Inoue. An application of fuzzy support vectors, Proceedings of the 22nd North American Fuzzy Information Processing Society, Chicago, Illinois, July 24–26, p.302– 306, (2003).

DOI: 10.1109/nafips.2003.1226801

[14] T. Inoue, S. Abe. Fuzzy support vector machines for pattern classi1cation, Proceedings of the International Joint Conference on Neural Networks, Washington DC, July 15C19, p.1449–1454, (2001).

[15] D. Tsujinishi, S. Abe. Fuzzy least squares support vector machines, Proceedings of the International Joint Conference on Neural Networks, Portland, Oregon, July 20–24, p.1599–1604, (2003).

DOI: 10.1109/ijcnn.2003.1223938

[16] S.R. Gunn, Support vector machines for classification and regression, Technical Report, Image Speech and Intelligent Systems Research Group, University of Southampton, UK, 1997, Available on http: /www. isis. ecs. soton. ac. uk/isystems/kernel.

[17] John Shawe–Taylor and Nello Cristianini. Kernel Methods for Pattern Analysis, Cambridge, UK: Cambridge University Press, (2004).