Active Rehabilitation Gloves Based on Brain-Computer Interfaces and Deep Learning

Abstract:

Cerebral stroke is the second leading cause of death and the third leading cause of death and disability in the world, and more than half of these patients have hand dysfunction, making hand rehabilitation an urgent challenge. In this study, a system for hand rehabilitation therapy for stroke patients was designed using novel human-computer interaction technology. The system combines a brain-computer interface, a deep learning algorithm and a rehabilitation glove, and designs an electroencephalogram (EEG) signal acquisition card and a rehabilitation glove to realise the application of motor imagery therapy to the active rehabilitation of patients' hands. On the brain-computer interface-based motor imagery experiments, the Long Short Term Memory (LSTM) recurrent neural network algorithm designed in this study achieves an average accuracy of 95.78% for the classification accuracy of mental tasks in seven motor imagery modes, which is important for the active rehabilitation of patients with hand function based on motor imagery-driven rehabilitation.

• Periodical: Journal of Biomimetics, Biomaterials and Biomedical Engineering (Volume 63)
• Pages: 49-62
• DOI: https://doi.org/10.4028/p-2Jc2QF
• Online since: November 2023
• Authors: Jia Hua Zhu, Xing Zhao Shi, Xing Yue Cheng, Qi Rui Yang, Ruo Xiu Xiao*
• Keywords: Brain Computer Interface (BCI), Cerebral Stroke, Classification, Electroencephalogram (EEG), Long Short Term Memory (LSTM)

References

[1] V. Feigin, B. Stark, CO. Johnson, Global, regional, and national burden of stroke and its risk factors, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019, The Lancet Neurology (2021) 795-820.

DOI: 10.1136/bmjgh-2020-004128

[2] X. Hu, Z. Wang, J. Wang, Progress and Prospects of Upper Limb Rehabilitation Robot for Stroke Patients, Chinese Journal of Rehabilitation Theory and Practice (2014) 901-904.

[3] S. Hatem, G. Saussez,M. Della Faille, et al. Rehabilitation of motor function after stroke: a multiple systematic review focused on techniques to stimulate upper extremity recovery, Frontiers in human neuroscience (2016) 442.

DOI: 10.3389/fnhum.2016.00442

[4] G. Gillen, Stroke rehabilitation: a function-based approach, Elsevier, London, 2016.

[5] MA. Rahmana, A-Al- Jumailya, Design and development of a hand exoskeleton for rehabilitation following stroke, Proc Eng (2012) 1028-1034.

[6] F. Abu-Dakka, M. Saveriano, Variable impedance control and learning—a review, Frontiers in Robotics and AI (2020) 590-681.

DOI: 10.3389/frobt.2020.590681

[7] X. Xian, Z. Jia, S. Yuan, Clinical Study on the Treatment of Upper Extremity Dysfunction in the Recovery Period of Ischemic Stroke with Brain Computer Interface Rehabilitation Training System, Medical Innovation of China (2020) 154-158.

[8] Q. Chu, C. Huo, T. Zhang, Cortical reorganization pattern of stroke patients under upper limb multi-joint linkage task, In 2022 12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER) (2022) 707-711.

DOI: 10.1109/cyber55403.2022.9907282

[9] N. Rungsirisilp, Y. Wongsawat, Applying Combined Action Observation and Motor Imagery to Enhance Classification Performance in a Brain–Computer Interface System for Stroke Patients, IEEE Access (2022) 145-155.

DOI: 10.1109/access.2022.3190798

[10] Y. Yu, X. Si, C. Hu, J. Zhang, A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures, Neural Comput (2019) 1235–1270.

DOI: 10.1162/neco_a_01199

[11] D. Wang, Y. Wang, B. Zi, Z. Cao, Development of an active and passive finger rehabilitation robot using pneumatic muscle and magnetorheological damper, Mechanism and Machine Theory (2022) 103762.

DOI: 10.1016/j.mechmachtheory.2019.103762

[12] C. Jeong, S. Yang, A Study on Development of High Flow Solenoid Valves, Journal of Drive and Control (2013) 7-13.

[13] Z. Tayeb, J. Fedjaev, N. Ghaboosi, et al, Validating deep neural networks for online decoding of motor imagery movements from EEG signals, Sensors (2019) 210.

DOI: 10.3390/s19010210

[14] Y. He, X. Wang, X. Ruan, Hybrid active damping combining capacitor current feedback and point of common coupling voltage feedforward for LCL-type grid-connected inverter, IEEE Transactions on Power Electronics (2020) 2373-2383.

DOI: 10.1109/tpel.2020.3008160

[15] R. Saha, K. Wu, R. Bloom, A review on magnetic and spintronic neurostimulation: challenges and prospects, Nanotechnology (2022) 182004.

DOI: 10.1088/1361-6528/ac49be

[16] P. Shull, S. Jiang, Y. Zhu, Hand gesture recognition and finger angle estimation via wrist-worn modified barometric pressure sensing, IEEE Transactions on Neural Systems and Rehabilitation Engineering (2019) 724-732.

DOI: 10.1109/tnsre.2019.2905658

[17] P. Karipoth, R. Dahiya, Printed Piezoresistive Strain sensors for Wearable Systems, In 2020 IEEE International Conference on Flexible and Printable Sensors and Systems (FLEPS) (2020) 1-4.

DOI: 10.1109/fleps49123.2020.9239478

[18] N. Kazemi, M. Abdolrazzaghi, P. Musilek, Comparative analysis of machine learning techniques for temperature compensation in microwave sensors, IEEE Transactions on Microwave Theory and Techniques (2021) 4223-4236.

DOI: 10.1109/tmtt.2021.3081119

[19] K. Maji, B. De, R. Kar, CMOS analog amplifier circuits design using seeker optimization algorithm, IETE Journal of Research (2022) 1376-1385.

DOI: 10.1080/03772063.2019.1649207

[20] G. Wang, F.Chen, N. Zhao, Current reconstruction considering time-sharing sampling errors for single DC-link shunt motor drives, IEEE Transactions on Power Electronics (2020) 5760-5770.

DOI: 10.1109/tpel.2020.3029335

[21] R. Roy, Y. Zheng, D. Kamper, Concurrent and Continuous Prediction of Finger Kinetics and Kinematics via Motoneuron Activities, IEEE Transactions on Biomedical Engineering (2022) 1109.

DOI: 10.1109/tbme.2022.3232067

[22] S. Morsalin, S. Lai, Front-end circuit design for electroencephalography (EEG) signal, In 2020 Indo–Taiwan 2nd International Conference on Computing, Analytics and Networks (Indo-Taiwan ICAN) (2020) 170-175.

DOI: 10.1109/indo-taiwanican48429.2020.9181346

[23] X.Hu, X. Deng, F. Wang, A review of second-life lithium-ion batteries for stationary energy storage applications, Proceedings of the IEEE (2022) 735-753.

DOI: 10.1109/jproc.2022.3175614

[24] Y. Guan, C. Cecati, J. Alonso Review of high-frequency high-voltage-conversion-ratio DC-DC converters, IEEE Journal of Emerging and Selected Topics in Industrial Electronics (2021)374-389.

DOI: 10.1109/jestie.2021.3051554

[25] A. Usakli, Improvement of EEG Signal Acquisition: An Electrical Aspect for State of the Art of Front End, Computational Intelligence and Neuroscience (2010) 7.

DOI: 10.1155/2010/630649

[26] A. Rasekh, M. Sharif Bakhtiar, Design of Low-Power Low-Area Tunable Active RC Filters, in IEEE Transactions on Circuits and Systems II: Express Briefs (2018) 6-10.

DOI: 10.1109/tcsii.2017.2658635

[27] K. Bhawna, M. Duhan, Electroencephalogram based biometric system: a review, Advances in Communication and Computational Technology: Select Proceedings of ICACCT (2019) 57-77.

DOI: 10.1007/978-981-15-5341-7_5

[28] L. Zhang, EEG signals classification using machine learning for the identification and diagnosis of schizophrenia, In 2019 41st annual international conference of the ieee engineering in medicine and biology society (EMBC) (2019) 4521-4524.

DOI: 10.1109/embc.2019.8857946

[29] D. Liu, B. Wang, T. Pan, et al, Toward quantitative near infrared brain functional imaging: lock-in photon counting instrumentation combined with tomographic reconstruction, IEEE access (2019) 29-42.

DOI: 10.1109/access.2019.2924710

[30] S. Spichtig, F. Scholkmann, L. Chin, et al, Assessment of intermittent UMTS electromagnetic field effects on blood circulation in the human auditory region using a near‐infrared system, Bioelectromagnetics (2012) 40-54.

DOI: 10.1002/bem.20682

[31] K. Gaikwad, M. Chavan, Removal of high frequency noise from ECG signal using digital IIR butterworth filter, In 2014 IEEE Global Conference on Wireless Computing & Networking (GCWCN) (2014) 121-124.

DOI: 10.1109/gcwcn.2014.7030861

[32] R. Gómez-García, L. Yang, JM. Muñoz-Ferreras, et al, Lossy signal-interference filters and applications, IEEE Transactions on Microwave Theory and Techniques (2019) 516-529.

DOI: 10.1109/tmtt.2019.2953585

[33] A. Sherstinsky, Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) network, Physica D: Nonlinear Phenomena (2020) 132306.

DOI: 10.1016/j.physd.2019.132306

[34] A. Rehmer, A. Kroll, On the vanishing and exploding gradient problem in Gated Recurrent Units, IFAC-PapersOnLine (2020) 1243-1248.

DOI: 10.1016/j.ifacol.2020.12.1342

[35] M. Xu, J. Yao, Z. Zhang, et al, Learning EEG topographical representation for classification via convolutional neural network, Pattern Recognition (2020) 107390.

DOI: 10.1016/j.patcog.2020.107390

[36] J. Zeng, X. Ma, K. Zhou, Enhancing attention-based LSTM with position context for aspect-level sentiment classification, IEEE Access (2019) 20462-20471.

DOI: 10.1109/access.2019.2893806

[37] Y. Sun, C. Xu, G. Li, et al, Intelligent human computer interaction based on non redundant EMG signal, Alexandria Engineering Journal (2020) 1149-1157.

DOI: 10.1016/j.aej.2020.01.015

[38] Y. Zhou, S. Huang, Z. Xu, et al, Cognitive workload recognition using EEG signals and machine learning: a review, IEEE Transactions on Cognitive and Developmental Systems (2021)799-818.

DOI: 10.1109/tcds.2021.3090217

[39] M. Khan, R. Das, H. Iversen, et al, Review on motor imagery based BCI systems for upper limb post-stroke neurorehabilitation: From designing to application, Computers in biology and medicine (2020) 103843.

DOI: 10.1016/j.compbiomed.2020.103843

[40] W. Yi, S. Qiu, H. Qi, et al, EEG feature comparison and classification of simple and compound limb motor imagery, Journal of neuroengineering and rehabilitation (2013) 1-12.

DOI: 10.1186/1743-0003-10-106

[41] A. Jiang, J. Shang, X. Liu, et al, Efficient CSP algorithm with spatio-temporal filtering for motor imagery classification, IEEE Transactions on Neural Systems and Rehabilitation Engineering (2020) 1006-1016.

DOI: 10.1109/tnsre.2020.2979464

[42] O. Ali, S. Kareem, A. Mohammed, Evaluation of Electrocardiogram Signals Classification Using CNN, SVM, and LSTM Algorithm: A review, In 2022 8th International Engineering Conference on Sustainable Technology and Development (IEC) (2022) 185-191.

DOI: 10.1109/iec54822.2022.9807511