Two-Dimensional Extensions of Neighborhood Preserving Embedding

Abstract:

Neighbourhood Preserving Embedding (NPE) is a novel subspace learning algorithm, which aims at preserving the local neighbourhood structure on the data manifold and is a linear approximation to Locally Linear Embedding (LLE). However, in typical image recognition in 1D vectors space, where the number of data samples is smaller than the dimension of data space, suffering from the singularity problem of matrix, NPE algorithm cannot be implemented directly. In this paper, we investigate NPE directly on image matrix for image recognition. The proposed two-dimensional neighbourhood preserving embedding (2DNPE) and bilateral two-dimensional neighbourhood preserving embedding (B2DNPE) algorithms are all based directly on 2D image matrices rather than on 1D vectors as NPE does, thus the problem of singularity confronted in 1D case is overcome. 2DNPE performs compression only in row direction, while B2DNPE performs compression both in row and in column direction. The relation of them to 2DLPP (B2DLPP) are also presented. The proposed algorithms are evaluated on ORL face database and handwritten digits database.

• Periodical: Applied Mechanics and Materials (Volumes 198-199)
• Pages: 420-425
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.198-199.420
• Online since: September 2012
• Authors: Da Ming Zhang, Hua Yong Liu, Juan Chen, Lu Li
• Keywords: Dimensionality Reduction, Image Recognition, Neighbourhood Preserving Embedding (NPE)

References

[1] R. O. Duda, P. E. Hart and D. G. Stork. Pattern Classification, second. Wiley, New York, (2001).

[2] J. Tenenbaum, V. de Silva, J. Langford, A global geometric framework for nonlinear dimensionality reduction, Science, 2000, 290(22): 2319-23.

DOI: 10.1126/science.290.5500.2319

[3] S.T. Roweis and L.K. Saul, Nonlinear dimensionality reduction by Locally Linear Embedding, Science, 2000, 290: 2323-6.

DOI: 10.1126/science.290.5500.2323

[4] M. Belkin, P. Niyogi, Laplacian Eigenmaps for dimensionality reduction and data representation, Neural Computation, 2003, 15: 1373-96.

DOI: 10.1162/089976603321780317

[5] Z. Zhang, H. Zha, Principal manifolds and nonlinear dimensionality reduction via tangent space alignment, SIAM J. Sci. Comput. 2004, 26(1): 313-38.

DOI: 10.1137/s1064827502419154

[6] X. He and P. Niyogi, Locality preserving projections, Proc. Conf. Advances in Neural Information Processing Systems, (2003).

[7] He X, Yan S, Hu Y, Niyogi P, and Zhang H J. Face recognition using Laplacian faces. IEEE Trans. on Pattern Anal. Machine Intelli., 2005, 27(3): 328-40.

DOI: 10.1109/tpami.2005.55

[8] Xiaofei He, Deng Cai, Shuicheng Yan, Hong-Jiang Zhang, Neighborhood preserving embedding, Tenth IEEE International Conference on Computer Vision (ICCV'05), 2005, 2: 1208-13.

DOI: 10.1109/iccv.2005.167

[9] J. Yang, D. Zhang, A.F. Frangi and J.Y. Yang, Two-dimensional PCA: A new approach to appearance-based faces representation and recognition, IEEE Trans. Pattern Analysis and Machine Intelligence, 2004, 26(1): 1-7.

DOI: 10.1109/tpami.2004.1261097

[10] M. Li and B. Yuan, 2D-LDA: A statistical linear discriminant analysis for image matrix. Pattern Recognition Letters, 2005, 26(5): 527-32.

DOI: 10.1016/j.patrec.2004.09.007

[11] Sibao Chen, Haifeng Zhao, Min Kong, Bin Luo, 2D-LPP: Two-dimensional Extension of Locality Preserving Projections, Neurocomputing, 2007, 70: 912-21.

DOI: 10.1016/j.neucom.2006.10.032

[12] D. Q. Zhang, Z.H. Zhou. (2d)PCA: Two-directional two-dimensional PCA for efficient face representation and recognition. Neurocomputing. 2005, 69: 224-31.

DOI: 10.1016/j.neucom.2005.06.004

[13] P. Nagabhushan, D. S. Guru, B. H. Shekar. (2d)2FLD: An efficient approach for appearance based object recognition. Neurocomputing. 2006, 69(7-9): 934-40.

DOI: 10.1016/j.neucom.2005.09.002

[14] Si-Bao Chen Bin Luo Guo-Ping Hu Ren-Hua Wang. Bilateral two-dimensional locality preserving projections. IEEE International Conference on Acoustics, Speech and Signal Processing, 2007. (ICASSP 2007). 2: II-601-II-4.

DOI: 10.1109/icassp.2007.366307