Implement of Robot Arm Body Feeling Interaction System Based on the Kinect Skeletal Information

Abstract:

This paper presents a novel method to control a robot arm based on the human skeletal information. First, the depth data is obtained by using a Kinect device. Skeletal tracking technology is used to deal with the depth data to match the various parts of the body and the 3D coordinates of each joint of the body are established. Then, the 3D coordinates are proposed to calculate the rotation angle of the human waist, shoulder, elbow and wrist joints. These four joints of the body are one-to-one correspondence with the four joints of 4-DOF robot arm. Finally, a transformation is conducted to map the calculation results into control commands, and the control commands are sent to the controller of robot arm by serial ports to achieve body feeling interaction. The experimental results show that the method can effectively control the robot arm to rotate and grab objects.

• Periodical: Applied Mechanics and Materials (Volumes 220-223)
• Pages: 1203-1206
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.220-223.1203
• Online since: November 2012
• Authors: Hai Bo Lin, Wei Lin Mei, Yi Zhang
• Keywords: Human Skeletal Information, Kinect Sensor, Robot Arm

References

[1] L. Yuan,X.Yu,Z.Yi:J. Robot, Vol. 34(1) (2012) p.110.

[2] L.Wei Q.X. Hui :J. Automatic Measurement and Control, Vol. 27(12) (2008) p.79.

[3] D.Tilak: J. Appled Ergonomics, Vol. 43(4) (2012) p.645.

[4] T. Jing, Z. Jin, L. Ligang: J. Transactions on Visualization and Computer Graphics, Vol. 18(4) (2012) p.643.

[5] K. Kourosh, E.S. Oude: J. Sensors, Vol. 12(2) (2012) p.1437.