Development of the Handwritten Numeral Recognition Based on Neural Network via Kinet Sensor

Abstract:

Purpose of this paper, coupled with Kinect controller, utilizes handwritten recognition for digit home interactive TV channel controlling. The results of this paper are divided into three parts. The first part presents the development of handwritten digit rules and operations environment using Principal curves method. The second part shows the skeleton tracking system for features extraction. The third part developes an accomplishment of digit recognition function through neural network. In this system, it enables users to operate video and finishs interactive operation in a more intuitive and friendly way, instead of the traditional button control to achieve interactive effect of human-machine interface.

• Periodical: Applied Mechanics and Materials (Volumes 321-324)
• Pages: 1162-1167
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.321-324.1162
• Online since: June 2013
• Authors: Jia Shing Sheu, Ho Nien Shou, Ya Ling Huang
• Keywords: Back Propagation Network, Feature Extraction, Principal Curves

References

[1] Sean Gustafson, Daniel Bierwirth and Patrick Baudisch, Imaginary Interfaces: Spatial Interaction with Empty Hands and without Visual Feedback, UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology, New York, USA, October 3–6 (2010).

DOI: 10.1145/1866029.1866033

[2] Jacob, R. J. K., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T. and Zigelbaum, J. Reality-based interaction: a framework for post-WIMP interface. Proceedings of the Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (Florence, Italy, 2008), ACM, 201-210, (2008).

DOI: 10.1145/1357054.1357089

[3] W.T. Freeman and Craig D. Weissman, Television Control by Hand Gesture, IEEE Intl. Wkshp. on Automatic Face and Gesture Recognition, Zurich, June, (1995).

[4] Orasa Patsadu, Chakarida Nukoolkit and Bunthit Watanapa, Human Gesture Recognition Using Kinect Camera, 2012 Ninth International Joint Conference on Computer Science and Software Engineering(JCSSE), (2012), pp.1921-1928.

DOI: 10.1109/jcsse.2012.6261920

[5] T. Hastie, Principal curves and surfaces, Stanford University, Department of Statistics, Technical Report 11, (1984).

[6] Q. Abbas, J. Ahmad, and W.H. Bangyal, Analysis of learning rate using BP algorithm for hand written digit recognition application, Proceeding of International Conference on Information and Emerging Technologies, (2010), pp.1-5.

DOI: 10.1109/iciet.2010.5625732

[7] C. Liao, F. Guimbreti`ere, K. Hinckley and J. Hollan, Papiercraft: A Gesture-based Command System for Interactive Paper, ACM Transactions on Computer-Human Interaction , vol. 14, no. 4, (2008), pp.1-27.

DOI: 10.1145/1314683.1314686

[8] Lane Marie Kuhlman, "Gesture Mapping for Interaction Design: An Investigative Process for Developing Interactive Gesture Libraries," Presented in Partial Fulfillment of the Requirements for The Degree of Masters of Fine Arts in The Graduate School of the Ohio State University, (2009), pp.157-160.

[9] B. Kegl, A. Krzyzak, T. Linder, and K. Zeger, Learning and design of principal curves, Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 22, (2000), pp.281-297.

DOI: 10.1109/34.841759

[10] Wensheng Li and Chunjian Deng, Fast and Robust Method for Dynamic Gesture Recognition Using Hermite Neural Network, Journal of Computers, vol. 7, no. 5, (2011), pp.1163-1168.

DOI: 10.4304/jcp.7.5.1163-1168