Automated Bin-Picking with Active Vision

Abstract:

In this research, an automated robotic bin-picking system employing active vision for picking up randomly distributed plumbing parts is presented. This system employs an actively-controlled single eye-in-hand system to observe structured light projected onto a set of plumbing parts in a bin. By using image processing and iterative closest point (ICP) algorithms, a single plumbing part that could possibly be taken from the bin is detected. Specifically, by projecting stationary structured light patterns onto the set of plumbing objects, the features on the surfaces of plumbing parts can be reconstructed by actively moving the eye-in-hand camera while performing visual tracking of those features. An effective 3D segmentation technique is employed to extract the point cloud of a single plumbing part that can possibly be grasped successfully. Once the object point cloud is obtained, one needs to determine the coordinate transformation from the end-effector to the selected plumbing part for grasping motion. With the point cloud matching result based on utilizing the ICP algorithm, the position and orientation of the selected plumbing part can be correctly estimated if the deviation of the object point cloud from the model point cloud is small. The control command can thus be given to the robotic manipulator to accomplish the automated bin-picking task. To effectively expand the allowed deviation of the object point cloud, an approximate pose estimation algorithm is employed before performing the ICP algorithm. The proposed approach can virtually estimate any pose of the plumbing part and has been successfully experimented with an industrial manipulator equipped with eye-in-hand single-camera vision and a LCD projector fixed in the work space demonstrating the feasibility and effectiveness. The proposed automated bin-picking system appears to be cost-effective and have great potentials in industrial factory automation applications.

• Periodical: Key Engineering Materials (Volume 625)
• Pages: 496-504
• DOI: https://doi.org/10.4028/www.scientific.net/KEM.625.496
• Online since: August 2014
• Authors: Wen Chung Chang*, Chia Hung Wu
• Keywords: Active Vision, Bin-Picking, Eye-in-Hand, ICP, Point Cloud Matching, Robotic Manipulator, Structured Light

References

[1] K. Rahardja and A. Kosaka, Vision-based bin-picking: recognition and localization of multiple complex objects using simple visual cues, in Proc. of 1996 IEEE/RSJ International Conference on Intelligent Robots and Systems '96, IROS 96, vol. 3, 4-8 Nov 1996, pp.1448-1457.

DOI: 10.1109/iros.1996.569005

[2] K. Liu, Z. Sun, M. Fujii, Ellipse detection based bin-picking visual servoing system, in Proc. of 2010 Chinese Conference on Pattern Recognition (CCPR), 21-23 Oct. 2010, pp.1-5.

DOI: 10.1109/ccpr.2010.5659176

[3] M. Ulrich, C. Wiedemann, and C. Steger, CAD-based recognition of 3D objects in monocular images, in Proc. of IEEE International Conference on Robotics and Automation, 2009, ICRA '09, 12-17 May 2009, pp.1191-1198.

DOI: 10.1109/robot.2009.5152511

[4] J. -K. Oh, S. Lee, C. -H. Lee, Stereo vision based automation for a bin-picking solution, International Journal of Control, Automation and Systems, vol. 10, no. 2, pp.362-373, April (2012).

DOI: 10.1007/s12555-012-0216-9

[5] W. -C. Chang, C. -H. Wu, J. -J. Jeng, and B. -T. Jiang, An automatic bin-bicking system for plumbing parts, in Proc. of 2012 CACS International Automatic Control Conference, National Formosa University, Yunlin, Taiwan, Nov. 30, 2012-Dec. 2, (2012).

[6] W. -C. Chang, V. -T. Nguyen, and P. -R. Chu, Reconstruction of 3D contour with an active laser-vision robotic system, Asian Journal of Control, vol. 14, no. 2, pp.400-412, March (2012).

DOI: 10.1002/asjc.361

[7] S. Kristensen, S. Estable, M. Kossow, and R. Brösel, Bin-picking with a solid state range camera, Robotics and Autonomous Systems, 2001, vol. 25, no. 3-4, pp.143-151.

DOI: 10.1016/s0921-8890(01)00123-3

[8] D. Buchholz, S. Winkelbach, and F.M. Wahl, RANSAM for industrial bin-picking, in Proc. of 2010 41st International Symposium on Robotics (ISR) and 2010 6th German Conference on Robotics (ROBOTIK), 7-9, June 2010, pp.1-6.

[9] G. Sansoni, P. Bellandi, F. Leoni, and F. Docchio, Optoranger: A 3D pattern matching method for bin picking applications, Optics and Lasers in Engineering, Volume 54, Pages 222-231, March (2014).

DOI: 10.1016/j.optlaseng.2013.07.014

[10] C.S. Chua and R. Jarvis, 3D free-form surface registration and object recognition, International Journal of Computer Vision, vol. 17, no. 1, pp.77-99, (1996).

DOI: 10.1007/bf00127819

[11] M. Körtgen , M. Novotni , and R. Klein, 3D shape matching with 3D shape contexts, in Proc. of 7th Central European Seminar on Computer Graphics, (2003).

[12] T. Masuda, Automatic registration of multiple range images by the local log-polar range images, in Proc. of Third International Symposium on 3D Data Processing, Visualization, and Transmission, 14-16 June 2006, pp.216-223.

DOI: 10.1109/3dpvt.2006.35

[13] C. Choi, Y. Taguchi, O. Tuzel, M. -Y. Liu, and S. Ramalingam, Voting-based pose estimation for robotic assembly using a 3D sensor, in Proc. of 2012 IEEE International Conference on Robotics and Automation (ICRA), 14-18 May 2012, pp.1724-1731.

DOI: 10.1109/icra.2012.6225371

[14] P.J. Besl and N.D. Mckay, A method for registration of 3-D shapes, in Proc. of IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 14, no. 2, Feb. 1992, pp.239-256.

DOI: 10.1109/34.121791

[15] M. Greenspan, M. Yurick, Approximate k-d tree search for efficient ICP, in Proc. of 2003 Fourth International Conference on 3-D Digital Imaging and Modeling, 6-10 Oct. 2003, pp.442-448.

DOI: 10.1109/im.2003.1240280