Obstacle Detection and Text Recognition for Assisting Visually Impaired People

Abstract:

As a potential medium for informing blind people, the project remodels the visual world into the audio world. In computer vision, Obstacle detection is the most widely used field with incredible achievement. The obstacles and texts can be enlightened to the visually impaired people where obstacles detected from the frame are addressed by their names and converted to speech. The image-to-text framework is an advanced innovation that is utilized to get the message in the image which will be extremely helpful to read any content. The voice result of the input text is produced by evaluating the adjoining and the recurrence of events of the words by the system. It is used to find the distance to the object that the user wants. This application is compact and helpful to economical society as well as an efficient assistant for visually impaired people. Thus, ultimately this could increase the confidence level of the user and make him/her feel secure.

• Periodical: Advances in Science and Technology (Volume 124)
• Pages: 72-79
• DOI: https://doi.org/10.4028/p-y9m106
• Online since: February 2023
• Authors: M. Aishwarya, S. Shivani, K. Deepthi*, Golda Dilip
• Keywords: Computer Vision, Convolutional Neural Network (CNN), Distance Estimation, Find Objects, Object Detection, Text Recognition, Text-to-Speech, Visually Impaired

References

[1] Muiz Ahmed Khan, Pias Paul, Mahmudur Rashid, Mainul Hossain, and Md Atiqur Rahman Ahad, An AI-Based Visual Aid with Integrated Reading Assistant for the Completely Blind,, IEEE Transactions on Human-machine Systems, Vol. 50, No. 6, December (2020).

DOI: 10.1109/thms.2020.3027534

[2] Zhong-Qiu Zhao, Peng Zheng, Shou-Tao Xu, and Xindong Wu, Object Detection with Deep Learning: A Review,, IEEE Transactions on Neural Networks and Learning Systems, Vol. 30, No. 11, November (2019).

DOI: 10.1109/tnnls.2018.2876865

[3] V. Padmapriya,R. Archna,V. Lavanya,CH. VeeralakshmiKrishnaveni Sri, A Study on text recognition and obstacle detection techniques,, IEEE  2020 International Conference on System, Computation, Automation and Networking (ICSCAN).

DOI: 10.1109/icscan49426.2020.9262368

[4] Md. Amanat Khan Shishir, Shahariar Rashid Fahim, Fairuz Maesha Habib, Tanjila Farah, Eye Assistant using mobile application to help the visually impaired,, IEEE 1st International Conference on Advances in Science, Engineering and Robotics Technology 2019 (ICASERT 2019).

DOI: 10.1109/icasert.2019.8934448

[5] Rajesh Kannan Megalingam; Palnati Teja Krishna Sai, Aditya Ashvin, Pochareddy Nishith Reddy, Bhargav Ram Gamini, Trinetra App: A Companion for the Blind,, IEEE 2021 Bombay Section Signature Conference (IBSSC).

DOI: 10.1109/ibssc53889.2021.9673267

[6] G Chandan, Ayush Jain, Harsh Jain, Mohana, Real Time Object Detection and Tracking Using Deep Learning and OpenCV,, IEEE 2018 International Conference on Inventive Research in Computing Applications (ICIRCA).

DOI: 10.1109/icirca.2018.8597266

[7] Bojan Strbac, Marko Gostovic, Zeljko Lukac, Dragan Samardzija, YOLO Multi-Camera Object Detection and Distance Estimation,, IEEE 2020 Zooming Innovation in Consumer Technologies Conference (ZINC).

DOI: 10.1109/zinc50678.2020.9161805

[8] Nouran Khaled, Shehab Mohsen, Kareem Emad El-Din, Sherif Akram, Haytham Metawie, Ammar Mohamed, In-Door Assistant Mobile Application Using CNN and TensorFlow,, IEEE 2020 International Conference on Electrical, Communication, and Computer Engineering (ICECCE).

DOI: 10.1109/icecce49384.2020.9179386

[9] Roshan Rajwani, Dinesh Purswani, Paresh Kalinani, Deesha Ramchandani, Indu Dokare, Proposed System on Object Detection for Visually Impaired People,, International Journal of Information Technology (IJIT) – Volume 4 Issue 1, Mar - Apr (2018).

[10] Miss Rajeshvaree Ravindra Karmarkar, Prof V.N. Honmane, Object Detection System for the Blind with Voice guidance", International Journal of Engineering Applied Sciences and Technology, 2021, Vol. 6, Issue 2. [11] Rakesh Chandra Joshi, Saumya Yadav, Malay Kishore Dutta, Carlos M. Travieso-Gonzalez, "Efficient Multi-Object Detection and Smart Navigation Using Artificial Intelligence for Visually Impaired People,, Entropy 2020, 22, 941.

DOI: 10.3390/e22090941

[12] Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi, You Only Look Once: Unified, Real-Time Object Detection,, IEEE 2016 Conference on Computer Vision and Pattern Recognition (CVPR).

DOI: 10.1109/cvpr.2016.91

[13] J. Nasreen, W. Arif, A. A. Shaikh, Y. Muhammad and M. Abdullah, Object Detection and Narrator for Visually Impaired People,, IEEE 2019 6th International Conference on Engineering Technologies and Applied Sciences (ICETAS).

DOI: 10.1109/icetas48360.2019.9117405

[14] Siva Ganga, Hema, A Review on Text Recognition for Visually Blind People,, International Research Journal of Engineering and Technology (IRJET), 2020, Volume 7, Issue 2.

[15] Hao Jiang, Thomas Gonnot, Won-Jae Yi, Jafar Saniie, Computer Vision and Text Recognition for Assisting Visually Impaired People using Android Smartphone,, IEEE 2017 International Conference on Electro Information Technology (EIT).

DOI: 10.1109/eit.2017.8053384

[16] Samruddhi Deshpande, Ms. Revati Shriram, Real Time Text Detection and Recognition on Hand Held Objects to Assist Blind People,, International Conference on Automatic Control and Dynamic Optimization Techniques (ICACDOT) (2016).

DOI: 10.1109/icacdot.2016.7877741

[17] M. Murali, Shreya Sharma and Neel Nagansure, Reader and Object Detector for Blind,, International Conference on Communication and Signal Processing (ICCSP) (2020).

DOI: 10.1109/iccsp48568.2020.9182201

[18] S. A. Jakhete, P. Bagmar, A. Dorle, A. Rajurkar, P. Pimplikar, Object Recognition App for Visually Impaired,, IEEE 2019 Pune Section International Conference (PuneCon).

DOI: 10.1109/punecon46936.2019.9105670

[19] A. Badave, R. Jagtap, R. Kaovasia, S. Rahatwad, S. Kulkarni, Android Based Object Detection System for Visually Impaired,, 2020 International Conference on Industry 4.0 Technology (I4Tech).

DOI: 10.1109/i4tech48345.2020.9102694

[20] Venkata Naresh Mandhala, Debnath Bhattacharyya, Vamsi B, Thirupathi Rao N, Object Detection Using Machine Learning for Visually Impaired People,, 2020 International Journal of Current Research and Review (IJCRR).

DOI: 10.31782/ijcrr.2020.122032

[21] Sanghyeon Lee, Moonsik Kang, Object Detection System for the Blind with Voice Command and Guidance,, IEIE Transactions on Smart Processing and Computing, vol. 8, issue 5, (2019).

DOI: 10.5573/ieiespc.2019.8.5.373

[22] Trupti Shah, Sangeeta Parshionikar, Efficient Portable Camera Based Text to Speech Converter for Blind Person,, International Conference on Intelligent Sustainable Systems (ICISS 2019).

DOI: 10.1109/iss1.2019.8907995

[23] Eliganti Ramalakshmi, Dixitha Kasturi, Gouthami V, Object Detector for Visually Impaired with Distance Calculation for Humans,, International Journal of Engineering and Advanced Technology (IJEAT), Vol 9 Issue 4, April, (2020).

[24] Fatima ZahraeAitHamou Aadi, Abdelalim Sadiq, Proposed real-time obstacle detection system for visually impaired assistance based on deep learning,, International Journal of Advanced Trends in Computer Science and Engineering, Vol 9, Issue 4, (2020).

DOI: 10.30534/ijatcse/2020/357942020

[25] P. Zhihao and C. Ying, Object Detection Algorithm based on Dense Connection,, 2019 IEEE 4th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), (2019).

DOI: 10.1109/iaeac47372.2019.8997591