Hand Gesture Recognition Used for Functioning System Using OpenCV

Abstract:

Recently much attention has been paid to the design of intelligent and natural user-computer interfaces. Hand Gesture Recognition systems has been developed continuously as its ability to interact with the machines. Now-a-days the news of metaverse ecosystem has increased the number of system in gesture recognition. Gestures are used to communicate with the PCs in a virtual environment. In this project Hand gestures are used to communicate information non-verbally which are free of expression to do a particular task. Here the hand gestures are recognized by using hand skeleton recognition using mediapipe library in python. In this project, the PC camera will record live video and recognizes the hand gestures based on which a particular functionality will take place. This project will present virtual keyboard, calculator and control system’s volume using hand gestures recognition technique by coding in Python using the OpenCV library.

• Periodical: Advances in Science and Technology (Volume 124)
• Pages: 3-10
• DOI: https://doi.org/10.4028/p-4589o3
• Online since: February 2023
• Authors: Shubh Patel*, R. Deepa
• Keywords: Hand Gesture Recognition, Hand Skeleton Recognition, Virtual Calculator, Virtual Keyboard, Virtual Volume Control

References

[1] Finger Recognition and Gesture based Virtual Keyboard, Chinnam Datta Sai Nikhil, Chukka Uma Someswara Rao, E.Brumancia, K.Indira, T.Anandhi, P.Ajitha, (2020).

DOI: 10.1109/icces48766.2020.9137889

[2] Hand Gesture Recognition using OpenCV and Python Surya Narayan Sharma, Dr. A Rengarajan, (2021).

[3] Xi, C.; Chen, J.; Zhao, C.; Pei, Q.; Liu, L. Real-time Hand Tracking Using Kinect. In Proceedings of the 2nd International Conference on Digital Signal Processing, Tokyo, Japan, 25–27 February (2018).

DOI: 10.1145/3193025.3193056

[4] Devineau, G.; Moutarde, F.; Xi, W.; Yang, J. Deep learning for hand gesture recognition on skeletal data. In Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi'an, China, 15–19 May (2018).

DOI: 10.1109/fg.2018.00025

[5] Jiang, F.; Wu, S.; Yang, G.; Zhao, D.; Kung, S.-Y. Independent hand gesture recognition with Kinect. Signal Image Video Process. (2014).

DOI: 10.1007/s11760-014-0668-x

[6] Konstantinidis, D.; Dimitropoulos, K.; Daras, P. Sign language recognition based on hand and body skeletal data. In Proceedings of the 2018-3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), Helsinki, Finland, 3–5 June (2018).

DOI: 10.1109/3dtv.2018.8478467

[7] De Smedt, Q.;Wannous, H.; Vandeborre, J.-P.; Guerry, J.; Saux, B.L.; Filliat, D. 3D hand gesture recognition using a depth and skeletal dataset: SHREC'17 track. In Proceedings of the Workshop on 3D Object Retrieval, Lyon, France, 23–24 April (2017).

DOI: 10.1016/j.cviu.2019.01.008

[8] Chen, Y.; Luo, B.; Chen, Y.-L.; Liang, G.; Wu, X. A real-time dynamic hand gesture recognition system using kinect sensor. In Proceedings of the 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China, 6–9 December (2015).

DOI: 10.1109/robio.2015.7419071

[9] Hand Gesture Recognition Based Calculator, Sandeep Kumar, Mohit Tanwar, Anand Kumar, Gita Rani, Prashant Chamoli, (2019).

[10] Skeleton-based Dynamic hand gesture recognition, Quentin De Smedt, Haze Wannous, Jean-Philippe Vandeborre Tel´ ecom Lille, Univ. Lille, CNRS, UMR 9189 - CRIStAL, F-59000 Lille, France.

DOI: 10.21926/cr.2201001

[11] Hand Gesture Recognition for Human Computer Interaction, Aashni Hariaa, Archanasri Subramaniana, Nivedhitha Asokkumara, Shristi Poddara ,Jyothi S Nayak, ICACC-2017, 22-24 August 2017, Cochin, India.

[12] Hand Gesture Recognition Based on Computer Vision: A Review of Techniques, Munir Oudah, Ali Al-Naji, Javaan Chahl, (2020).

DOI: 10.3390/jimaging6080073