A Novel Adaptive Fast Learning Algorithm for 2DPCA

Abstract:

We propose a novel adaptive fast learning (AFL) algorithm for two-dimensional principal component analysis (2DPCA) in this paper. As opposite to conventional PCA which is based on 1D data vectors, 2DPCA is based on 2D image matrices and thus has higher accuracy than conventional PCA when applied to applications such as face recognition, facial expression recognition, palmprint recognition, etc. Our proposed AFL algorithm simultaneously estimates both eigenvectors and corresponding eigenvalues, and then adaptively sets the learning rate parameters of neurons to ensure all neurons learning with almost the same fast speed. Requiring no image covariance matrix evaluation, the desired multiple eigenvectors of 2DPCA can thus be learned effectively in the form of weight vectors of neurons. The proposed AFL algorithm can also be applied to learning for T-2DPCA. Simulation experiments performed on face database such as the YaleB database clearly demonstrate that the proposed AFL algorithm performs very well and thus is a very effective computational tool for both 2DPCA and T-2DPCA.

• Periodical: Applied Mechanics and Materials (Volume 311)
• Pages: 129-134
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.311.129
• Online since: February 2013
• Authors: Liang Hwa Chen, Yen Ching Chang, Po Lun Chang, Chun Ming Chang
• Keywords: 2DPCA, Learning Algorithm, Neural Network (NN), Principal Component Analysis (PCA)

References

[1] D. Reich, A.L. Price, N. Patterson, Principal component analysis of genetic data, Nature Genetics, 40(5) (2008) 491–492.

DOI: 10.1038/ng0508-491

[2] Q. Du and J.E. Fowler, Hyperspectral Image Compression Using JPEG2000 and Principal Component Analysis, IEEE Geoscience and Remote Sensing Letters, 4(2) (2007) 201–205.

DOI: 10.1109/lgrs.2006.888109

[3] C.Y. Chang, H.R. Hsu, Application of Principal Component Analysis to a Radial-basis Function Committee Machine for Face Recognition, International Journal of Innovative Computing, Information and Control, 5(11B) (2009) 4145–4154.

[4] M. Turk, A. Pentland, Eigenfaces for Recognition, Journal of Cognitive Neuroscience, 3(1) (1991) 71–86.

[5] J. Yang, D. Zhang, A.F. Frangi, J.Y. Yang, Two-dimensional PCA: a new approach to appearance-based face representation and recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(1) (2004) 131–137.

DOI: 10.1109/tpami.2004.1261097

[6] D. Zhang, Z.H. Zhou, (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition, Neurocomputing, 69(1–3) (2005) 224–231.

DOI: 10.1016/j.neucom.2005.06.004

[7] J. Tao, W. Jiang, Z. Gao, S. Chen, C. Wang, Palmprint Recognition Based on Improved 2DPCA, Agent Computing and Multi-Agent Systems, (2006) 455–462.

DOI: 10.1007/11802372_43

[8] W. Sun, Q. Ruan, Two-Dimension PCA for Facial Expression Recognition, 2006 8th International Conference on Signal Processing, (2006).

DOI: 10.1109/icosp.2006.345747

[9] P. Nagabhushan, D. S. Guru, B. H. Shekar, Visual learning and recognition of 3D objects using two-dimensional principal component analysis: A robust and an efficient approach, Pattern Recognition, 39(4) (2006) 721–725.

DOI: 10.1016/j.patcog.2005.11.008

[10] L.H. Chen, P.L. Chang, F.H. Hsieh, 2D Principal Component Analysis Using a Novel Learning Algorithm, ICIC Express Letters, Part B: Applications, 2(1) (2011) 195–201.

[11] H.J. Kushner, Stochastic Approximation Methods for Constrained and Unconstrained Systems, Springer-Verlag, New York, 1978.

[12] E. Oja, Simplified neuron model as a principal component analyzer, Journal of Mathematical Biology, 15(3) (1982) 267–273.

DOI: 10.1007/bf00275687

[13] L.H. Chen, S. Chang, An adaptive learning algorithm for principal component analysis, IEEE Transactions on Neural Networks, 6(5) (1995) 1255–1263.

DOI: 10.1109/72.410369

[14] YaleB Face Database, http://cvc.yale.edu/projects/yalefacesB/yalefacesB.html.