Recognizing Gestures for Humanoid Robot Using Proto-Symbol Space

Abstract:

This paper describes the non Verbal communication method for developing a gesture-based system using Mimesis model. The proposed method is applicable to any hand gesture represented by a multi-dimensional signal. The entire work concentrates mainly on hand gestures recognition. It develops a way to communicate between Humans and the Humanoid Robots through gestural medium. The Mimesis is the technique of performing human gestures through imitation, recognition and generation. Different Gestures are being converted into code words through the use of code book. These code words are then converted into Proto-Symbols, these proto symbol then forms basis for training of the Humanoid robot. The recognition part is performed through a “distance vector”, a novel algorithm developed by us which is a combination of Euclidean distance and K-nearest neighbor. The generation part is done through the use of WEBOTS which include use of Humanoid robot HOAP 2 having 25 degrees of freedom. All the process of training, recognition and generation are simulated through MATLAB.

• Periodical: Advanced Materials Research (Volumes 403-408)
• Pages: 4769-4776
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.403-408.4769
• Online since: November 2011
• Authors: Nitin Kumar, Suraj Prakash Sahu, Jay Prakash Maurya, G.C. Nandi, Pavan Chakraborty
• Keywords: Euclidean Distance, Gestures, HMM, HOAP-2 Humanoid Robot, Mimesis Model, Proto-Symbol, Real-Time, WEBOTS Simulation Software

References

[1] Inamura , T. ; Nakamura, Y.; Toshima, I.; Ezaki, H.; Mimesis embodiment and proto-symbol acquisition for humanoids, Advanced Intelligent Mechatronics, 2001. Proceedings. 2001 IEEE/ASME International Conference on, vol. 1, no., pp.159-164 vol. 1, (2001).

DOI: 10.1109/aim.2001.936447

[2] T. Inamura, I. Toshima, H. Tanie, and Y. Nakamura, Embodied symbol emergence based on mimesis theory, The International Journal of Robotics Research, vol. 23: 3-5, p.363–377, (2004).

DOI: 10.1177/0278364904042199

[3] Inamura, T.; Nakamura, Y.; Ezaki, H.; Toshima, I.; , Imitation and primitive symbol acquisition of humanoids by the integrated mimesis loop, Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on , vol. 4, no., pp.4208-4213 vol. 4, (2001).

DOI: 10.1109/robot.2001.933275

[4] Takano, W.; Tanie, H.; Nakamura, Y.; , Key feature extraction for probabilistic categorization of human motion patterns, " Advanced Robotics, 2005. ICAR , 05. Proceedings., 12th International Conference on, vol., no., pp.424-430, 18-20 July (2005).

DOI: 10.1109/icar.2005.1507445

[5] Kuniyoshi, Y.; Inaba, M.; Inoue, H.; , Learning by watching: extracting reusable task knowledge from visual observation of human performance, Robotics and Automation, IEEE Transactions on , vol. 10, no. 6, pp.799-822, Dec (1994).

DOI: 10.1109/70.338535

[6] Stefan Schaal. Is imitation learning the way to humanoid robots? Trends in Cognitive Sciences, Vol. 3, No. 6, pp.233-242, (1999).

DOI: 10.1016/s1364-6613(99)01327-3

[7] Mataric, M.J.;, Getting humanoids to move and imitate, Intelligent Systems and their Applications, IEEE , vol. 15, no. 4, pp.18-24, Jul/Aug (2000).

DOI: 10.1109/5254.867908

[8] Qiang Huang; Kaneko, K.; Yokoi, K.; Kajita, S.; Kotoku, T.; Koyachi, N.; Arai, H.; Imamura, N.; Komoriya, K.; Tanie, K.; , Balance control of a piped robot combining off-line pattern with real-time modification, " Robotics and Automation, 2000. Proceedings. ICRA , 00. IEEE International Conference on , vol. 4, no., pp.3346-3352 vol. 4, (2000).

DOI: 10.1109/robot.2000.845227

[9] Webots Software, http: /www. cyberbotics. com/products/webots.

[10] Miyazawa, M.; Peifeng Zeng; Iso, N.; Hirata, T.;, A systolic algorithm for Euclidean distance transform, Pattern Analysis and Machine Intelligence, IEEE Transactions on , vol. 28, no. 7, pp.1127-1134, July (2006).

DOI: 10.1109/tpami.2006.133

[11] Shiliang Sun; Rongqing Huang; , An adaptive k-nearest neighbor algorithm, Fuzzy Systems and Knowledge Discovery (FSKD), 2010 Seventh International Conference on , vol. 1, no., pp.91-94, 10-12 Aug. (2010).

DOI: 10.1109/fskd.2010.5569740