Measurement Error Correction of y Coordinate in Three Dimensional Localization of Tomatoes Using Binocular Stereo Vision

Abstract:

Accuracy three dimensional coordinates of fruits and vegetables are very important to harvesting robots to harvest fruits and vegetables correctly. To decrease the measurement errors of the y coordinates of tomatoes, we analyzed the measurement errors of y coordinate acquired using binocular stereo vision based on three stereo matching methods. These three stereo matching methods were centroid-based, area-based, and combination stereo matching methods. After stereo matching, the three dimensional coordinates of tomatoes could be acquired based on the triangle ranging principle. Tests of 225 pairs of stereo images of three plastic balls used as normal balls acquired at the distances from 300 to 1000 mm showed that the ranges of the measurement errors of y coordinate acquired based on three stereo matching methods changed with the image acquisition distances obviously. Moreover, the measurement errors of y coordinate appeared linear decreasing trends approximately. Therefore, binary linear regression models were set up to reduce the ranges of the measurement errors of y coordinate of three balls. These models were used as correction models of the measurement values of y coordinate and were helpful to reduce the measurement errors of y coordinate. However, there were owe correction and overcorrection conditions when the image acquisition distances were smaller and larger than 750 mm separately. Then, the correction models based on piecewise binary linear regression were used to solve this problem. The ranges of the measurement errors of y coordinate were reduced further. Tests of 225 pairs of stereo images of three tomatoes acquired at the distances from 300 to 1000 mm showed that the ranges of the measurement errors of y coordinate acquired based on three stereo matching methods were separately from [-20.9, -6.6], [-19.9, -3.44], [-19.9, -3.48] mm to [-6.84, -0.06], [-5.84, -0.82], [-5.85, -0.83] mm after the correction using the piecewise binary linear regression models. It proved that the piecewise binary linear regression models were helpful to reduce the measurement errors of y coordinate in three dimensional localization of tomatoes using binocular stereo vision.

• Periodical: Applied Mechanics and Materials (Volume 610)
• Pages: 209-215
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.610.209
• Online since: August 2014
• Authors: Rong Xiang*, Huan Yu Jiang, Yi Bin Ying
• Keywords: Error, Harvesting Robots, Localization, Stereo Vision, Three Dimension, Tomato

References

[1] E.J. van Henten, J. Hemming, B. A. J. Van Tuijl, J. G. Kornet, J. Meuleman, J. Bontsema, and E. A. Van Os, An Autonomous Robot for Harvesting Cucumbers in Greenhouses, Autonomous Robots. 13(2002) 241-258.

DOI: 10.1023/a:1020568125418

[2] N. Kondo, K. Ninomiya, S. Hayashi, T. Ota, and K. Kubota, A New Challenge of Robot for Harvesting Strawberry Grown on Table Top Culture, in: 2005 ASAE Annual International Meeting, ASAE, Tampa, 2005, Paper No. 053138.

DOI: 10.13031/2013.19110

[3] X.J. Zou, H. X. Zou, and J. Lu, Virtual Manipulator-based Binocular Stereo Vision Positioning System and Errors Modeling, Machine Vision and Applications. 23(2012) 43-63.

DOI: 10.1007/s00138-010-0291-y

[4] A.R. Jiménez, A. K. Jain, and R. Ceres, Automatic Fruit Recognition: a Survey and New Results Using Range/Attenuation Images, Pattern Recognition. 32(1999) 1719-1736.

DOI: 10.1016/s0031-3203(98)00170-8

[5] K. Tanigaki, T. Fujiura, and A. Akase, Cherry-harvesting Robot, Computers and Electronics in Agriculture. 63(2008) 65-72.

DOI: 10.1016/j.compag.2008.01.018

[6] A. Busch, and P. Palk, An Image Processing Approach to Distance Estimation for Automated Strawberry Harvesting, in: M. Kamel, A. Campiho (Eds. ), Image Analysis and Recognition, Springer Berlin Heidelberg, Berlin, 2011, pp.389-396.

DOI: 10.1007/978-3-642-21596-4_39

[7] J. Song, Target Positioning of Picking Robot Fusing Laser Ranging and Vision. in: Y. H. Yang, M. Ma (Eds. ), Green Communications and Networks, Springer Netherlands, Berlin, 2012, pp.985-993.

DOI: 10.1007/978-94-007-2169-2_117

[8] R. Xiang, Y. B. Ying, H. Y. Jiang, X. Q. Rao, and Y. S. Peng, Recognition of Overlapping Tomatoes Based on Edge Curvature Analysis, Transactions of the Chinese Society for Agricultural Machinery. 43(2012) 157-162.

[9] H. Y. Jiang, Y. S. Peng, C. Shen, and Y. B. Ying, Recognizing and Locating Ripe Tomatoes Based on Binocular Stereo Vision Technology, Transactions of the CSAE. 24(2008) 279-283.

[10] R. Xiang, Y. B. Ying, H. Y. Jiang, and Y. S. Peng, Localization of Tomatoes Based on Binocular Stereo Vision, Transactions of the Chinese Society of Agricultural Engineering. 28(2012) 161-167.