Research of Hand Gesture Recognition in Multi-Touch Projector-Camera System

Abstract:

This paper studys the feasibility of the shadow of interactive gestures on the projection screen as the control instructions in a projection interactive system. With regard to complex background of the projection screen, we put forward to detect mobile gestures and the shadows of gestures by using the way of the Gaussian mixture model. Relative to the non-rigid body interaction gestures, The shadow of gestures has a simpler two-dimensional characteristics and greater differences from the other regions of the projection screen. Based on this characteristics, we adopt Ostu threshold segmentation algorithm to remove the interference of the gestures. Then we use the mixed way of the radial symmetry transform and curvature threshold to position the interactive fingertips as interactive instruction of the projector-camera system. Conctroling the screen in a wide range without carrying any equipment is completed. The experimental results show that this method is easy to operate and has a high accuracy rate.

• Periodical: Advanced Materials Research (Volumes 588-589)
• Pages: 1184-1187
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.588-589.1184
• Online since: November 2012
• Authors: Wen Jie Li, Li Ming Wu, Chen Liu
• Keywords: Calibration, Fingertip Detection, Fingertip Location, Human-Computer Interaction (HCI), Shadow Detection

References

[1] Zhu Zhongdi Research of Key Algorithms on ProCams based HCI . University of Science and Technology of China A dissertation for master's degree 2011. 5.

[2] Goto, H.; Kawasaki,Y. Nakamura A development of an information projection interface using a projector-camera system RO-MAN, 2010 IEEE 13-15 Sept. 2010 pp.50-55.

DOI: 10.1109/roman.2010.5598663

[3] Mei Pinghua, LiBin, Zhu Zhongdi. Real time fingertip detection using radial symmetry transform. Journal Of University Of Science And Technology Of China. 2011, 41(2): 103-106.

[4] Hyosun Kim, Dieter W. Fellne. Interaction with Hand Gesture for a Back-Projection Wall. Computer Graphics International, 2004. Proceedings 2004, pp.395-402.

DOI: 10.1109/cgi.2004.1309240

[5] Liu, Hui, Yang, Chenhui; Shu, Xiao; A new method of shadow detection based on edge information and HSV color information PEITS 2009-2nd, v1, pp.286-289, (2009).

DOI: 10.1109/peits.2009.5407014

[6] Prati, A. (Dipto. di Scienze dell'Ingegneria); Shadow detection algorithms for traffic flow analysis: Proceedings, ITSC, pp.340-345, (2001).