Intelligent Human Eye State Identification Based on 2DPCA and Skin Color

Abstract:

Human eye state identification can be applied not only to monitoring of the drowsiness of a human car driver but also to medical treatment facilitating system for monitoring neonate or stuporous patient. Once the patient awake and open his eyes, human eye state identification system can notify nurses to take care of the patient. In this work, we propose an intelligent human eye state identification algorithm based on 2DPCA and skin color. Adaboost face detection function of OpenCV is first adopted to detect the human faces in color images acquired from camera. Then, we develop a more precise HSV skin color model and use it to eliminate the false alarms in the previous stage. Next, a heuristic segmentation method based on skin color and face geometry is proposed to segment the region of eyes, from which 2DPCA is then adopted to extract the features and identify the opening or closing state of eyes. We study three kinds of 2DPCA, i.e. 2DPCA, T-2DPCA and (2D)²PCA, and compare their performance. Experimental results reveal that our algorithm can achieve over 90% accuracy rate.

• Periodical: Applied Mechanics and Materials (Volume 145)
• Pages: 252-256
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.145.252
• Online since: December 2011
• Authors: Liang Hwa Chen, Po Lun Chang, Guo Wei Lin, Yen Ching Chang
• Keywords: 2DPCA, Eye State Identification, Face Detection, Skin Color

References

[1] C.A. Perez: Real-time iris detection on coronal-axis-rotated faces, IEEE Transactions on Systems, Man and Cybernetics. Part C, Applications and Reviews, Vol. 37 (2007), pp.971-978.

DOI: 10.1109/tsmcc.2007.900647

[2] K. Peng, L. Chen, S. Ruan and G. Kukharev: A robust algorithm for eye detection on gray intensity face without spectacles, Journal of Computer Science and Technology, Vol. 5 (2005), pp.127-132.

DOI: 10.1007/11552499_34

[3] H. Liu, Y. Wu and H. Zha: Eye states detection from color facial image sequence, Second International Conf. on Image and Graphics, (2002), pp.693-698.

DOI: 10.1117/12.477054

[4] S. Dhar, T. Pradhan, S. Gupta and A. Routray: Implementation of real time visual attention monitoring algorithm of human drivers on an embedded platform, Proceedings of the 2010 IEEE Students' Technology Symposium, Kharagpur, April (2010).

DOI: 10.1109/techsym.2010.5469154

[5] P. Viola and M. Jones: Rapid object detection using a boosted cascade of simple features, IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 1 (2001), pp.551-518.

DOI: 10.1109/cvpr.2001.990517

[6] D. Maio and D. Maltoni: Real-time face location on gray-scale static image, Pattern Recognition, Vol. 33 (2000), pp.1525-1539.

DOI: 10.1016/s0031-3203(99)00130-2

[7] O. Ikeda: Segmentation of faces in video footage using color for face detection and image retrieval, ICIP2003, Vol. 3 (2003), pp. III-913-6.

DOI: 10.1109/icip.2003.1247394

[8] S.A. Nazeer, et al.: Face detection using artificial neural network approach, First Asia International Conference on Modelling & Simulation, (2007), pp.394-399.

[9] J. M. Chaves-Gonzalez et al.: Detecting skin in face recognition systems: A colour spaces study, Digital Image Processing, Vol. 20 (2010), pp.806-823.

DOI: 10.1016/j.dsp.2009.10.008

[10] M. Turk and A. Pentland: Eigenfaces for recognition, J. Cognitive Neuroscience, Vol. 3 (1991), pp.71-86.

[11] D.T. Lin: Facial expression classification using PCA and hierarchical radial basis function network, Journal of Information Science and Engineering, Vol 22 (2006), pp.1033-1046.

[12] J. Yang, D. Zhang et al.: Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 26 (2004), pp.131-137.

DOI: 10.1109/tpami.2004.1261097

[13] R.C. Gonzalez and R.E. Woods: Digital Image Processing, 3rd Edition, Prentice Hall (2007).

[14] D. Zhang and Z.H. Zhou: (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition, Neurocomputing, Vol 69 (2005), pp.224-231.

DOI: 10.1016/j.neucom.2005.06.004