SIGN BOT Extending an Ability to Communicate by Creating an Indian Sign Language

Abstract:

There is a communication lag between deaf-mutes and normal people. To overcomethat, we are providing information access and services to deaf-mute people in Indian Sign Language (ISL) and developing a flexible project that can be enlarged to capture the entire lexicon of Indian Sign Language via physical gestures like hand expressions and non-manual signs like facial expressions by developing and building a training model using machine learning algorithms. Sign language recognition uses image-based manual and non-manual gestures. Here we used figure recognition to identify manual and non-manual gestures. Finding expression gestures and analyzing finger movements to determine what the deaf-dumb individual is saying. In Python, the MediaPipe recognizes the hand signs and facial gestures of a person. These modules were developed to assist people with non-identical motions. This paper presents figure identification of Indian Sign Language via hand and facial gestures, as well asits integration with a chatbot as transcript output.

• Periodical: Advances in Science and Technology (Volume 124)
• Pages: 20-27
• DOI: https://doi.org/10.4028/p-i494gi
• Online since: February 2023
• Authors: S. Sampath Kumar, Kumar V. Ajay, Nataraj S. Arun*, B. Devasarathy, B. Hariharan
• Keywords: Artificial Intelligence Mark-Up Language, Convolutional Neural Network (CNN), Indian Sign Language, MediaPipe, OpenCV, RELU, Softmax

References

[1] Divya, K. S., Subha, R., & Palaniswami, S. (2014). Similar words identification using naive and tf-idf method. International Journal of Information Technology and Computer Science (IJITCS), 6(11), 42.

DOI: 10.5815/ijitcs.2014.11.06

[2] Subha, R., & Palaniswami, S. (2013, January). Quality factor assessment and text summarization of unambiguous natural language requirements. In International Conference on Advances in Computing, Communication and Control (pp.131-146). Springer, Berlin, Heidelberg.

DOI: 10.1007/978-3-642-36321-4_12

[3] Subha, R., & Palaniswami, S. (2013). Ontology extraction and semantic ranking of unambiguous requirements. Life Science Journal, 10(2), 131-8.

[4] S Sampath Kumar & R. Rajeswari, An Automated Crop and Plant Disease Identification Scheme Using Cognitive Fuzzy C-Means Algorithm,, IETE Journal of Research, (2020).

DOI: 10.1080/03772063.2020.1780163

[5] S Sampath Kumar & R. Rajeswari, Heuristic Optimization Using Gene Navigation with the Gravitational Search Algorithm,, Journal of Electrical Engineering, Vol. 19, No. 2, (2019).

[6] A Anandaraj, PJA Alphonse,Tree based Ensemble for Enhanced Prediction (TEEP) of epileptic seizures,, International Journal of Intelligent Data Analysis,Volume 26,Issue 1,Page 133-151, IOS Press,1/1/2022.

DOI: 10.3233/ida-205534

[7] A. Anandaraj, P. Yeshwanth Ram, K. Sri Ram Kumar, M. Revanth and R. Praveen, Book Recommendation System with TensorFlow,, 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS), 2021, pp.1665-1669,.

DOI: 10.1109/icaccs51430.2021.9441927

[8] D Thiyagarajan, N Shanthi, A modified multi objective heuristic for effective feature selection in text classification, Cluster Computing 22 (5), 10625-10635.

DOI: 10.1007/s10586-017-1150-7

[9] D Thiyagarajan, N Shanthi, S Navaneethakrishnan, A Web Search Engine-Based Approach To Measure Semantic Similarity Between Words, International Journal of Advanced Engineering Research and Studies. E-ISSN2249– 8974.

[10] S Yuvaraj, M Krishnamoorthi,A novel hybrid optimization algorithm for data clustering,, International Journal of Computer Applications, (2013).

[11] B Hemalatha, S Yuvaraj, KV Kiruthikaa, V Viswanathan,Automatic Detection of Lung Cancer Identification using ENNPSO Classification,, International Conference on Advances in Computing and Communication Engineering (ICACCE),(2019).

DOI: 10.1109/icacce46606.2019.9079963

[12] Kiruthikaa K.V, Vijay Franklin J, Yuvaraj S, Analysis of Prediction Accuracy of Heart Diseases using Supervised Machine Learning Techniques for Developing Clinical Decision Support Systems,, International Journal of Recent Technology and Engineering, (IJRTE), (2018).

[13] Prathiba, E Angel Anna; Saravanan, B; "HASBE for Access Control by Separate Encryption/Decryption in Cloud Computing" ,International Journal of Emerging Trends in Electrical and Electronics (IJETEE) Vol: 2, Page: 66-71, (2013).

[14] Selvapriya, S; Saravanan, B,"Diagnosis of Brain Tumor Using Chemical Shift Displacement Correction"", IJIRCCE, 2014,.

[15] G. Karthikeyan, Dr G. Komarasamy, Dr. Daniel Madan Raja, An Efficient Method for Heart Disease Prediction Using Hybrid Classifier Model in Machine Learning,, Annals of the Romanian Society for Cell Biology, ISSN:1583- 6258, Vol. 25, Issue 4, 2021, Pages. 5708 - 5717.

[16] G. Karthikeyan, A Cross-Sectional Survey On Parallel Data Partitioning Clustering Algorithms,, International Journal on Applications in Engineering and Technology, Volume 3: Issue 3: p.17 – 21, (2017).