The Development of Supervised Motion Learning and Vision System for Humanoid Robot


Article Preview

With the development of the concept of Industry 4.0, research relating to robots is being paid more and more attention, among which the humanoid robot is a very important research topic. The humanoid robot is a robot with a bipedal mechanism. Due to the physical mechanism, humanoid robots can maneuver more easily in complex terrains, such as going up and down the stairs. However, humanoid robots often fall from imbalance. Whether or not the robot can stand up on its own after a fall is a key research issue. However, the often used method of hand tuning to allow robots to stand on its own is very inefficient. In order to solve the above problems, this paper proposes an automatic learning system based on Particle Swarm Optimization (PSO). This system allows the robot to learn how to achieve the motion of rebalancing after a fall. To allow the robot to have the capability of object recognition, this paper also applies the Convolutional Neural Network (CNN) to let the robot perform image recognition and successfully distinguish between 10 types of objects. The effectiveness and feasibility of the motion learning algorithm and the CNN based image classification for vision system proposed in this paper has been confirmed in the experimental results.



Edited by:

Ruangdet Wongla




S. T. Lin et al., "The Development of Supervised Motion Learning and Vision System for Humanoid Robot", Applied Mechanics and Materials, Vol. 886, pp. 188-193, 2019

Online since:

January 2019




* - Corresponding Author

[1] Information on

[2] Information on

[3] Information on

[4] Information on

[5] Damasceno, Nielsen Castelo, and Oscar Gabriel Filho. PI controller optimization for a heat exchanger through metaheuristic Bat Algorithm, Particle Swarm Optimization, Flower Pollination Algorithm and Cuckoo Search Algorithm., IEEE Latin America Transactions 15.9 (2017).


[6] Zhu, Qingling, et al. An External Archive-Guided Multiobjective Particle Swarm Optimization Algorithm., IEEE transactions on cybernetics 47.9 (2017): 2794-2808.


[7] Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton. Imagenet classification with deep convolutional neural networks., Advances in neural information processing systems. (2012).


[8] Simard, Patrice Y., David Steinkraus, and John C. Platt. Best practices for convolutional neural networks applied to visual document analysis., ICDAR. Vol. 3. (2003).


[9] Information on

[10] Information on