Natural Human-Computer Interaction Based on Finger Tracking

Article Preview

Abstract:

Large touch screen systems (LTSS) have been widely used in scientific, industrial, educational and artistic domains. They are easy and natural for people to use. We present a novel touch screen interaction with finger pointing and operating. To track the high freedom of fingertips with quick changes and self-occlusion by using ordinary cameras is a complex and challenging task. We propose a series of computer vision (CV) algorithms to fix initial position, coordinates mapping, fingertip detection, fingertip tracking, fingertip pose recognition, and generate control instructions. Evaluation shows our system is simply implemented and has a great effect.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

3990-3993

Citation:

Online since:

August 2013

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2013 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] Chung, P.K., Fang, B., and Quek, F. Mirrortrack-a vision based multitouch system for glossy display surfaces. p.571–576. IET, (2008).

DOI: 10.1049/cp:20080379

Google Scholar

[2] Lee, T. and Hollerer, T. Handy ar: Markerless inspection of augmented reality objects using fingertip tracking. p.83–90. IEEE, (2007).

DOI: 10.1109/iswc.2007.4373785

Google Scholar

[3] Locken, A., Hesselmann, T., Pielot, M., Henze, N., and Boll, S. Usercentred process for the definition of free-hand gestures applied to controlling music playback. Multimedia Systems, p.1–17, (2012).

DOI: 10.1007/s00530-011-0240-2

Google Scholar

[4] Radkowski, R. and Stritzke, C. Interactive hand gesture-based assembly for augmented reality applications. p.303–308. The Fifth International Conference on Advances in Computer-Human Interactions, (2012).

Google Scholar

[5] Shen, Y., Ong, SK, and Nee, AYC. Vision-based hand interaction in augmented reality environment. Intl. Journal of Human Computer Interaction, 27(6): 523–544, (2011).

DOI: 10.1080/10447318.2011.555297

Google Scholar

[6] Singh, A. Review article digital change detection techniques using remotely-sensed data. International Journal of Remote Sensing, 10(6): 989–1003, (1989).

DOI: 10.1080/01431168908903939

Google Scholar

[7] Tosas, M. Visual articulated hand tracking for interactive surfaces. PhD thesis, (2006).

Google Scholar

[8] Yuan, X. and Memon, A.M. Iterative execution-feedback model-directed gui testing. Information and Software Technology, 52(5): 559–575, (2010).

DOI: 10.1016/j.infsof.2009.11.009

Google Scholar