Driver Yawn Prediction Using Convolutional Neural Network

Abstract:

Driver weariness is the leading cause of road accidents, according to numerous studies. Computer vision algorithms have shown promise in detecting indicators of exhaustion from facial motions like yawning. Precision and consistent yawning recognition is difficult in the real-world driving environment due to the various facial gestures and expression of driver. Yawning causes a mouth deformation in a variety of facial activities and expressions. This paper provides a novel way to based on minor facial motion identification to address the aforementioned concerns. We offer a for nuanced face activity recognition. Bidirectional and 3D convolutional networks are used in this network. A keyframe selection technique is used to discover the most from delicate face gestures. This method employs photo histograms to swiftly eliminate redundant frames and the median absolute deviation to locate outliers. A variety of tests are also run on the method.

• Periodical: Advances in Science and Technology (Volume 124)
• Pages: 268-276
• DOI: https://doi.org/10.4028/p-43g8x2
• Online since: February 2023
• Authors: Jharge S.R. Melvin, B. Rokesh*, S. Dheepajyothieshwar, K. Akila

References

[1] M. A. Su-Gang et al., Yawning detection algorithm based on convolutional neural network,, Comput. Sci., (2018).

[2] H. A. Kholerdi, N. TaheriNejad, R. Ghaderi, and Y. Baleghi, Driver's drowsiness detection using an enhanced image processing technique inspired by the human visual system,, Connection Sci., vol. 28, no. 1, p.27–46, Jan 2, (2016).

DOI: 10.1080/09540091.2015.1130019

[3] Jongseong Gwak , Akinari Hirao, Motoki Shino An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing, (2020).

DOI: 10.3390/app10082890

[4] F. Faraji, F. Lotfi, J. Khorramdel, A. Najafi, A. Ghaffari Drowsiness Detection Based On Driver Temporal Behavior Using a New Developed Dataset, (2021).

[5] Qaisar Abbas FatigueAlert: A real-time fatigue detection system using hybrid features and Pre-train CNN model,(2020).

[6] C. M. Martinez, M. Heucke, F. Wang, B. Gao, and D. Cao, Driving style recognition for intelligent vehicle control and advanced driver assistance: A Survey,, IEEE Trans. Intell. Transp. Syst., vol. 19, no. 3, p.666–676, Mar. (2018).

DOI: 10.1109/tits.2017.2706978

[7] P. S. Rau, Drowsy driver detection and warning system for com- mercial vehicle drivers: Field operational test design, data analy- ses, and progress,, in Proc. Nat. Highway Traffic Saf. Admin., 2005, p.05– 0192.

[8] A. D. McDonald, J. D. Lee, C. Schwarz, and T. L. Brown, Steer-ing in a random forest: Ensemble learning for detecting drowsiness- related lane departures,, Human Factors, vol. 56, no. 5, p.986–998, Aug. (2014).

DOI: 10.1177/0018720813515272

[9] W. Sun, X. Zhang, S. Peeta, X. He, and Y. Li, A real-time fatigue driv-ing recognition method incorporating contextual features and two fusion levels,, IEEE Trans. Intell. Transp. Syst., vol. 18, no. 12, p.3408–3420, Dec. (2017).

DOI: 10.1109/tits.2017.2690914

[10] Y. Zhang and C. J. Hua, Driver fatigue recognition based on facial ex-pression analysis using local binary patterns,, Optik, vol. 126, no. 23, p.4501–4505, (2015).

DOI: 10.1016/j.ijleo.2015.08.185

[11] C. Anitha, M. K. Venkatesha, and B. S. Adiga, A two fold expert sys-tem for yawning detection,, in Proc. IEEE 2nd Int. Conf. Intell. Comput., Commun. Convergence., vol. 92, p.63–71, (2016).

DOI: 10.1016/j.procs.2016.07.324