A Real Time Hand Gesture Recognition System Based on DFT and SVM

Abstract:

Vision based band gesture recognition provides a more nature and powerful means for human-computer interaction. A fast detection process of hand gesture and an effective feature extraction process are presented. The proposed a hand gesture recognition algorithm comprises four main steps. First use Cam-shift algorithm to track skin color after closing process. Second, in order to extract feature, we use BEA to extract the boundary of the hand. Third, the benefits of Fourier descriptor are invariance to the starting point of the boundary, deformation, and rotation, and therefore transform the starting point of the boundary by Fourier transformation. Finally, outline feature for the nonlinear non-separable type of data was classified by using SVM. Experimental results showed the accuracy is 93.4% in average and demonstrated the feasibility of proposed system.

• Periodical: Applied Mechanics and Materials (Volumes 284-287)
• Pages: 3004-3009
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.284-287.3004
• Online since: January 2013
• Authors: Wen Her Chen, Ching Tang Hsieh, Tsun Te Liu
• Keywords: BEA, Camshift, Hand Gesture Recognition, Support Vector Machine (SVM)

References

[1] Y. Mikio, Interface system based on hand gestures and verbal expressions for 3-D shape generation, Terebijon Gakkaishi/Journal of the Institute of Television Engineers of Japan, vol. 50, no. 10, pp.1482-1488, (1996).

[2] V. I. Pavlovic, R. Sharma and T. S. Huang, Visual Interpretation of Hand Gestures for Human-Computer Interaction : A Review, IEEE Trans. PAMI., vol. 19, no. 7, (1997).

DOI: 10.1109/34.598226

[3] C. Oh-Young, K. Hyoung-Gon, K. Sung-Jea and A. Sang Chul, A Hand Gesture Recognition System for Interactive Virtual Environment, IEEK, 36-s(4), pp.70-82, (1999).

[4] T. S. Huang and V. I. Pavlovic, Hand Gesture Modeling, Analysis and Synthesis, Proc. Int'l Workshop on Automatic Face and Gesture Recognition, pp.73-79, (1995).

[5] Teng, X., Wu, B. , Yu, W., Liu, C. : A hand gesture recognition system based on local linear embedding. Journal of Visual Languages and Computing, vol. 16, p.442–454, (2005).

DOI: 10.1016/j.jvlc.2005.04.003

[6] N. Hiroaki, Virtual environment for modeling 3D objects through spatial interaction, in: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics 6 (1999) VI-81–VI-86.

[7] S. Mu-Chun, A neural-network-based approach to recognizing 3D arm movements, Biomedical Engineering—Applications, Basis and Communications, vol. 15, no. 1, pp.17-26, (2003).

DOI: 10.4015/s1016237203000043

[8] T. Burger, A. Caplier, and S. Mancini, Cued speech hand gestures recognition tool, in Proceedings of the 13th European Signal Processing Conference (EUSIPCO '05), Antalya, Turkey, September (2005).

[9] C. Kuan-Yu, C. Cheng-Chin, C. Wen-Lung and T. Jyh-Tong, An Integrated Color and Hand Gesture Recognition Approach for an Autonomous Mobile Robot, 3rd International Congress on Image and Signal Processing (CISP), p.2496 – 2500, (2010).

DOI: 10.1109/cisp.2010.5647930

[10] S. D. Buluswar and B. A. Draper, Learning object color: ATR in color images, 8th British Machine Vision Conference, Sept. (1997).

[11] JongShill Lee, YoungJoo Lee and EungHyuk Lee, Hand region extraction and Gesture recognition from video stream with complex background through entropy analysis, 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp.1513-1516, (2004).

DOI: 10.1109/iembs.2004.1403464

[12] C. Yen-Ting and T. Kuo-Tsung, Multiple-angle Hand Gesture Recognition by Fusing SVM Classifiers, IEEE International Conference on Automation Science and Engineering, pp.527-530, (2007).

DOI: 10.1109/coase.2007.4341729

[13] Yu Ren and Fengming Zhang, Hand Gesture Recognition Based on MEB-SVM, International Conference on Embedded Software and Systems, pp.344-349, (2009).

DOI: 10.1109/icess.2009.21

[14] H. Deng-Yuan, H. Wu-Chih and C. Sung-Hsiang, Vision-Based Hand Gesture Recognition Using PCA+Gabor Filters and SVM, 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp.1513-1516, (2009).

DOI: 10.1109/iih-msp.2009.96

[15] Gao, Jianpo; Wu, Zhenyang; Wang, Yujian. Face tracking algorithm based on mean shift and ellipse fitting. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v 4233 LNCS-II, 2006, p.270.

DOI: 10.1007/11893257_30

[16] Bradski, G. R. Computer Vision Face Tracking for Use in a Perceptual User Interface,. Intel Technology Journal, vol. 2, no. 2, pp.13-27, (1998).

[17] Y. H. Liu, Feature Analysis and Classifier Design and Their Applications to Pattern Recognition and Data Mining, Ph.D. Disseration, National Taiwan Univ., R.O.C., (2003).

[18] R. L. Cosgriff, Identification of shape, Technical Report 802-11, Ohio State University, Columbus, OH, Dec. (1960).

[19] N. Cristianini and J. S. Taylor, An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, pp.82-108, Cambridge University Press, (2004).

DOI: 10.1017/cbo9780511801389