Signal Processing Methods for Improvement of Environmental Perception of Persons with Deafblindness

Abstract:

Environmental perception is a functional area that is severely limited in persons with deafblindness (DB) who belong a category of people with severe disabilities. Monitor is a vibratory aid developed with the aim to improve environmental perception of persons with DB. The aid consists of a mobile phone with an application connected to a microphone and vibrator. Monitor picks up the sounds produced by events by microphone, processes the sound using an algorithm programmed as an application in the mobile phone and then presents the signal via the vibrator to the persons with DB to be sensed and interpreted. In previous laboratory studies, four algorithms (AM, AMMC, TR, and TRHA) were developed based on modulating, and transposing principles. The algorithms were tested by persons with normal hearing/hearing impairment and selected as good candidates to improve vibratory identification of environmental sounds. In this on-going the algorithms are tested by 13 persons with congenital D and five persons with DB using Monitor in a realistic environment, living room, kitchen or office. Forty five recorded environmental sounds were used as test stimuli. The subjects tested the algorithms two times, Test and Retest each including a test session initiated by a training session. The four algorithms were tested in four days at Test and four days at Retest in total eight test days. Each test day began with a training session where a sound was presented as vibrations to be sensed by the person with the aim to remember its pattern and identity. The 45 sounds were grouped in four groups where an specific algorithm was chosen to process an specific sound group in a specific day. At the test session a sound was presented and the person was given 5 randomly chosen sound alternatives to choose the one as represented sound. The algorithms were different for different sound groups during four different test days so all algorithms were used to process all sounds. The algorithms were tested a second time, Retest, in same way as in Test. The mean value of identification of environmental sounds varied between 74.6% and 84.0% at Test and between 86.9% and 90.4% at Retest. The identification results at Retest were significantly improved (p<0.01) for all algorithms after a relatively short time of training indicating a good learning effect. At Test the algorithm AM was significantly better than the algorithms AMMC and TRHA (p< 0.01) and the algorithm TR was better than TRHA (p<0.01). The algorithms AM, AMMC, and TR were selected as good candidates to be implemented in the Monitor to improve environmental perception.

• Periodical: Advanced Materials Research (Volume 902)
• Pages: 398-404
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.902.398
• Online since: February 2014
• Authors: Ranjbar Parivash
• Keywords: Deaf, Deafblindness, Environmental Perception, Haptic, Monitor, Signal Processing, Vibrotactile

References

[1] Ranjbar, P., Sensing the Environment: Development of Monitoring Aids for Persons with Profound Deafness or Deafblindness, in School of Science and Technology2009, Örebro Universitet: Örebro p.188.

[2] Sundström, B. and E. Borg, Gravt hörselskadade och vuxendövas nytta och/eller besvär med hörapparat, 2004, Ahlséns Forskningsinstitut: Örebro. p.86.

[3] Borg, E., Cutaneous senses for detection and localization of environmental sound sources: a review and tutorial. Scand Audiol, 1997. 26(4): pp.195-206.

DOI: 10.3109/14992029709048007

[4] Borg, E., et al. Monitoring environmental events: problems, strategies and sensory compensation. in ISAC'00 Conference. 2000. Exeter.

[5] Reed, C.M. and L.A. Delhorne, The reception of environmental sounds through wearable tactual aids. Ear and Hearing, 2003. 24(6): pp.528-538.

DOI: 10.1097/01.aud.0000100207.97243.88

[6] Spens, K. -E. and G. Plant, A tactual hearing, aid for the deaf. STL-QPSR, 1983. 24(1): pp.52-56.

[7] Ranjbar, P. and I. Stenstrom, Monitor, a vibrotactile aid for environmental perception: a field evaluation by four people with severe hearing and vision impairment. ScientificWorldJournal, 2013. 2013: p.206734.

DOI: 10.1155/2013/206734

[8] Sadeghi, M., Usher syndrome. Prevalence and phenotype - genotype correlations, in Department of Audiology, The Sahlgrenska Academy2005, Göteborg University: Göteborg. p.191.

[9] Ranjbar, P., et al., Auditive identification of signal-processed environmental sounds: Monitoring the environment. International Journal of Audiology, 2008. 47(12): pp.724-736.

DOI: 10.1080/14992020802289776

[10] Ranjbar, P., E. Borg, and D. Stranneby, Vibrotactile identification of signal-processed sounds from environmental events. Journal of Rehabilitation Research and Development, 2009. 46(3).

DOI: 10.1682/jrrd.2008.11.0150

[11] Ranjbar, P., Vibrotactile identification of signal-processed sounds from environmental events presented by a portable vibrator: A laboratory study. Iranian Rehabilitation Journal, 2008. 6(7 & 8): pp.24-38.