Human Machine Interface in Weld Seam Detection Using an RGB-D Camera

Abstract:

The set-up time in robotic welding needs to be reduced so that it can be used for limited production runs. One challenge in achieving this reduction is the automatic localisation of the weld seam. A method is developed in this paper to locate the weld seams by human-machine interface. In particular, this method uses an RGB-Depth sensor, such as the Microsoft XBOX Kinect sensor, to identify a human hand that is pointing at the weld seam. A ‘hybrid hand detector’ is developed to recognise the human hand and fingers using both the depth and colour information. In turn it enables the identification of the weld seam. Experimental results shown that the weld seam can be reliably identified using the proposed method at near real time speeds.

• Periodical: Advanced Materials Research (Volumes 875-877)
• Pages: 1967-1971
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.875-877.1967
• Online since: February 2014
• Authors: Glenn Alexander Silvers, Gu Fang
• Keywords: Hand Recognition, Hybrid Hand Detector, RGB-D Sensing, Robotic Welding, Weld Seam Detection

References

[1] K. Micallef, G. Fang and M. Dinham: Automatic Seam Detection and Path Planning in Robotic Welding., in Robotic Welding, Intelligence and Automation, (Eds.: TJ Tarn, SB Chen and G Fang), Springer-Verlag Berlin Heidelberg (2011), 23 – 32.

DOI: 10.1007/978-3-642-19959-2_3

[2] M. Dinham, G. Fang and J.J. Zou: Experiments on Automatic Seam Detection For a MIG Welding Robot,. in Artificial Intelligence and Computational Intelligence, (Eds. H Deng, etc), Springer-Verlag Berlin Heidelberg, (2011), 390 – 397.

DOI: 10.1007/978-3-642-23887-1_49

[3] S.B. Chen, X.Z. Chen, T. Qiu and J.Q. Li: Acquisition of Weld Seam Dimensional Position Information for Arc Welding Robot Based on Vision Computing,. in: J. of Int. & Rob. Systems, (2005). 43(1): 77-97.

DOI: 10.1007/s10846-005-2966-6

[4] J.C. Fraile-Marinero, V. Gutierrez-Diez, and J. Perez-Turiel: Integrated robotic system development for arc-welding application with artificial vision. " in: Industrial Electronics Society, 1989. IECON , 89., 15th Annual Conference of IEEE. (1989).

DOI: 10.1109/iecon.1989.69694

[5] A. Erol, G. Bebis, M. Nicolescu, R.D. Boyle, and X. Twombly: Vision-based hand pose estimation: A review., Computer Vision and Image Understanding 108, no. 1 (2007): 52-73.

DOI: 10.1016/j.cviu.2006.10.012

[6] Lowe, D.G., Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 2004. 60(2): pp.91-110.

DOI: 10.1023/b:visi.0000029664.99615.94

[7] H. Bay, T. Tuytelaars, and L. Van Gool: SURF: Speeded Up Robust Features Computer Vision,. – ECCV 2006, A. Leonardis, H. Bischof, and A. Pinz, Editors. (2006), Springer Berlin / Heidelberg. pp.404-417.

DOI: 10.1007/11744023_32

[8] S. Suzuki, and K. Abe: Topological structural analysis of digitized binary images by border following,. Computer Vision, Graphics, and Image Processing, (1985). 30(1): pp.32-46.

DOI: 10.1016/0734-189x(85)90016-7

[9] J. Sklansky: Measuring Concavity on a Rectangular Mosaic,. Computers, IEEE Transactions on, (1972). C-21(12): pp.1355-1364.

DOI: 10.1109/t-c.1972.223507

[10] C. Heng-Tze, S. Zheng, and Z. Pei: Imirok: Real-time imitative robotic arm control for home robot applications., in 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops). (2011).

DOI: 10.1109/percomw.2011.5766906

[11] Z. Duric, F. Li, and H. Wechsler: Recognition of arm movements. in Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference on. (2002).

DOI: 10.1109/afgr.2002.1004178

[12] M. Tang: Recognising Hand Gestures with Microsoft's Kinect, in Engineering (2011), Stanford University. p.12.

[13] N.M. Kwok, Q.P. Ha, and G. Fang: Effect of color space on color image segmentation. " In Image and Signal Processing, 2009. CISP, 09. 2nd International Congress on, 1-5. IEEE, (2009).

DOI: 10.1109/cisp.2009.5304250