Graph Regularized Semi-Supervised Concept Factorization

Article Preview

Abstract:

Concept Factorization (CF) is a new matrix decomposition technique for data representation. A modified CF algorithm called Graph Regularized Semi-supervised Concept Factorization (GRSCF) is proposed for addressing the limitations of CF and Local Consistent Concept Factorization (LCCF), which did not consider the geometric structure or the label information of the data. GRSCF preserves the intrinsic geometry of data as regularized term and use the label information as semi-supervised learning, it makes nearby samples with the same class-label are more compact, and nearby classes are separated. Compared with Non-Negative Matrix Factorization (NMF), CNMF, CF and LCCF, experiment results on ORL face database and Coil20 image database have shown that the proposed method achieves better clustering results.

You have full access to the following eBook

Info:

[1] D. D. Lee and H.S. Seung.: Algorithms for Nonnegative Matrix Factorization. Adv. Neural Inf. Process. Syst, vol. 2(2000) 556-562.

Google Scholar

[2] W. Xu and Y. Gong.: Document Clustering by Concept Factorization. in Proc. 2004 Annual ACM SIGIR Conference (2004).

DOI: 10.1145/1008992.1009029

Google Scholar

[3] D. Cai, X. He, X. Wu, and J. Han.: Graph Regularized Non-negative Matrix Factorization for Data Representation. IEEE Trans. Patt. Anal. Mach. Intel, vol. 33, no. 8 (2011), 1548-1560.

DOI: 10.1109/tpami.2010.231

Google Scholar

[4] X. Liu, S. Yan, and H. Jin.: Projective Nonnegative Graph Embedding. IEEE Trans. Image Process, vol. 19, no. 5 (2010) 1126-1137.

DOI: 10.1109/tip.2009.2039050

Google Scholar

[5] Z. Yuan and E. Oja. : Projective Nonnegative Matrix Factorization for Image Compression and Feature Extraction. in Proc. Scand. Conf. Image Analysis(2005) 333-342.

DOI: 10.1007/11499145_35

Google Scholar

[6] D. Cai, X. He and J. Han.: Locally Consistent Concept Factorization for Document Clustering, IEEE Trans. Know. Data Eng, vol. 23, no. 6, June (2011) 902-913.

DOI: 10.1109/tkde.2010.165

Google Scholar

[7] H. Liu, Z. Wu, D. Cai and T. S. Huang.: Constrained Non-negative Matrix Factorization for Image Representation. IEEE Trans. Pattern Anal. Mach., vol. 34, no. 7 (2012) 1299-1311.

DOI: 10.1109/tpami.2011.217

Google Scholar

[8] X. Zhu, Z. Ghahramani, and J. Lafferty.: Semi-supervised Learning Using Gaussian Fields and Harmonic Functions. in Proc. of the twentieth International Conference on Machine Learning, (2003).

Google Scholar

[9] C. Ding, T. Li, W. Peng and H. Park.: Orthogonal Nonnegative Matrix Tri-factorizations for Clustering. in Proc. 12th ACM SIGKDD int. Conf. Know. Disc. Data Mining (2006) 126-135.

DOI: 10.1145/1150402.1150420

Google Scholar