Curvilinear Bipedal Walk Learning in Nao Humanoid Robot Using a CPG Based Policy Gradient Method

Abstract:

In this paper we will introduce a new learning approach for curvilinear bipedal walking of Nao humanoid robot using policy gradient method. A policy of walking is modeled by some policy parameters controlling some factors in programmable central pattern generators. A “Programmable” central pattern generator is made with coupled nonlinear oscillators capable to shape their state equations with some training trajectories. The proposed model has many benefits including smooth walking patterns, and modulation during walking to increase or decrease its speed. A suitable curvilinear walk was achieved, which is very similar to human ordinary walking. This model can be extended and used in Nao soccer player both in standard platform and 3D soccer simulation leagues of Robocup competitions to train different types of motions.

• Periodical: Applied Mechanics and Materials (Volumes 110-116)
• Pages: 5161-5166
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.110-116.5161
• Online since: October 2011
• Authors: Hamed Shahbazi, Kamal Jamshidi, Amir Hasan Monadjemi
• Keywords: Bipedal Walking, Central Pattern Generator (CPG), Curvilinear Walking, Nao Humanoid Robot, Policy Gradient Learning

References

[1] A.J. Ijspeert, Central pattern generators for locomotion control in animals and robots: a review, Journal of Neural Networks, Elsivier, Vol 21/4, pp.642-653, (2008).

DOI: 10.1016/j.neunet.2008.03.014

[2] J.J. Kuffner, S. Kagami, Dynamically-stable Motion Planning for Humanoid Robots, Journal of Autonomous Robots vol. 12, No. 1, pp.105-118., (2002).

[3] A.J. Beng Tay, Walking Nao Omnidirectional Bipedal Locomotion , Thesis in University of New South Wales, (2009).

[4] Cherubini, F. Giannone, L. Iocchi, M. Lombardo, G. Oriolo, Policy gradient learning for a humanoid soccer robot, Journal of Robotics and Autonomous Systems 57, pp.808-818, (2009).

DOI: 10.1016/j.robot.2009.03.006

[5] P. Marc, Nao programming for the Robotstadium on-line contest, Master semester project, Ecole Polytechnique Federale de Lausanne EPFL Biologically Inspired Robot Group, (2010).

DOI: 10.3940/rina.innovsail.2010.14

[6] Y. Bachar, Development Controllers for Biped Humanoid Locomotion, Master's thesis, School of Informatics, University of Edinburgh, (2004).

[7] M. Vukobratovic , D. Juricic, Contribution to the Synthesis of Biped Gait, IEEE Trans. On Bio-Medical Engineering, vol. BME-16, no. 1, pp.1-6, (1969).

DOI: 10.1109/tbme.1969.4502596

[8] J. Pratt, P. Dilworth and G. Pratt. virtual model control of a biped walking robot. In Proc. IEEE Int'l Conf. on Robotics & Automation, pp.193-198, (1997).

DOI: 10.1109/robot.1997.620037

[9] C. Niehaus, T. Rofer, T. Laue, Gait optimization on a humanoid robot using particle swarm optimization, in: Proc. of Second Workshop on Humanoid Soccer Robots, IEEE-RAS International Conference on Humanoid Robots, (2007).

DOI: 10.1109/ichr.2007.4813927

[10] L. Righetti , A.J. Ijspeert, Programmable Central Pattern Generators: an application to biped locomotion control, Proceedings of the 2006 IEEE International Conference on Robotics and Automation Orlando, Florida - May (2006).

DOI: 10.1109/robot.2006.1641933