Development of a Tool for Assisting Group Conversation by Re-Voicing Supportive Responses

Abstract:

Interactive group conversation is very important for improvement of cognitive function and prevention of dementia. Interactive means that all the participants participate equally and actively into group conversation. How to make group conversation more interactive for all participants is a challenging task. Main purpose of this study is to develop the system that assists group conversation, which is capable of dealing with following things, face detection and recognition, speech certain contents recognition, repetition or re-voice of supportive responses based on the result of speech contents recognition, and sound source localization using less sensory environment. We did dialogue experiments with arbitrary pairs among seven young adults and analyzed 14 dialogue data for calculating correct recognition rate of face and speech certain contents, for synthesizing speech based on the result of recognition, and for calculating sound source. The performance of the developed system was preliminary verified through the experimental results. The developed system can be used as a basis of assisting group conversation.

• Periodical: Applied Mechanics and Materials (Volumes 446-447)
• Pages: 1040-1044
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.446-447.1040
• Online since: November 2013
• Authors: Myagmarbayar Nergui, Mihoko Otake
• Keywords: Face Recognition, Group Conversation, Speech Contents Recognition, Speech Synthesis

References

[1] M. Valenzuela: Brain power: why using it helps stop losing it. http: /theconversation. com/brain-power-why-using-it-helps-stop-losing-it-6531, visited on June 12, 2013 (2012).

[2] R. Hari and M.V. Kujala: Brain basis of human Social Interaction: From concepts to Brain Imaging. Physil Rev 89: 453-479, American Physiological Society (2009).

DOI: 10.1152/physrev.00041.2007

[3] M. Otake: Coimagination method: sharing imagination with images and time limit. In Proceedings of the International Reminiscence and Life Review Conference (2009).

[4] T. Yamaguchi, J. Ota, and M. Otake: A system that assists group conversation of older adults by evaluating speech duration and facial expression of each participant during conversation. IEEE international Conference on Robotics and Automation, pp.4481-4486, USA (2012).

DOI: 10.1109/icra.2012.6225283

[5] Kinect Documentation & API Resources| Microsoft Kinect for Windows. http: /www. microsoft. com/en-us/kinectforwindows/develop/resources. aspx, visited on April, (2013).

[6] K. Nakadai, T. Takahashi, H. Okuno, H. Nakajima, Y. Hasegawa, and H. Tsujino (2010).

[7] M. Otake, M. Nergui, S. Moon, K. Takagi, T. Kamashima, K. Nakadai: Development of a Sound Source Localization System for Assisting Group Conversation. Submitted to ICIRA 2013, Korea (2013).

DOI: 10.1007/978-3-642-40852-6_54