Mechatronics Systems Supported by Vision Techniques

Abstract:

In the paper an application of vision methods and algorithms in various domains that contribute to mechatronics is presented. Regarding mechatronics devices and machines as robots, a vision system employed for a testing station simulating an industrial assembly line is discussed. Some numerical aspects concerning image pre-processing, analysis and geometrical transformations commonly used in robotics were introduced. To accomplish an effective investigation, the developed methodology and algorithms were implemented and verified on an experimental setup composed of two industrial robots and automation devices cooperating with two various vision systems. In the case of underwater robots for tank inspection, image pre-processing and analysis algorithms for the robot's position estimation, an image scale calculation and wall crack detection were investigated. An active vibration control system is treated as a mechatronic device which contains mechanical parts, electronics and software. In this example, a visual servoing architecture based on image features for controlling an active vibration control system was examined. For an effective investigation and synthesis of visual servoing algorithms, a MATLAB/Simulink/dSPACE hardware–software environment was employed. A vision system was used to analyze vibration amplitude of the vibro-isolation mass of the active suspension system and to provide a feedback control signal. The connection of 3D vision techniques with modal analysis was shown. Within the confines of the project a methodology for amplitude of vibration measurement and a software tool for modal analysis realization based on visual data were developed. The 3D measurements and structure of the construction were obtained by application and development of passive 3-D vision techniques. From this area, ‘structure from motion’ techniques were developed. In the experimental research, a mechatronic test stand was designed and manufactured enabling automatic two-axis control of a camera. A frame structure was built, in which a guiding-rail system was mounted enabling straight-line motion of a camera. Additionally, a system realizing rotational motion of a camera was built in. To control the experiment stand, software was created enabling the combination of the hardware-software part of the stand with the software part of a vision system. A tool was developed for the purpose of modal analysis and estimation of the quantities characterizing dynamic properties of the structure based on vision signals. As a conclusion, the presented, implemented and tested vision methods in various hardware-software programming platforms are discussed

• Periodical: Solid State Phenomena (Volume 196)
• Pages: 62-73
• DOI: https://doi.org/10.4028/www.scientific.net/SSP.196.62
• Online since: February 2013
• Authors: Piotr Kohut
• Keywords: Image Analysis, Image Preprocessing, Mechatronic System, Modal Analysis, Vision Based Measurements, Vision System, Visual Servoing

References

[1] T.Uhl, T. Bojko, Z. Mrozek, W. Szwabowski, Rapid prototyping of mechatronic systems, J. of Theoret. and Appl. Mech.; vol.38, no.3 (2000) 645–668.

[2] S. Hutchinson, G. Hager, G. P. Corke, A tutorial on visual servo control', IEEE Trans. on Rob. and Aut. 12(5), (1996) 651–670.

DOI: 10.1109/70.538972

[3] P. Fillatreau, F.X. Bernard, A. Aztiria, E. Saénz de Argandoña, C. García, N. Arana, A. Izaguirre, Sheet metal forming global control system based on artificial vision system and force – acoustic sensors, Rob. and Comp.-Integ. Manuf. 24, (2008) 780 – 787.

DOI: 10.1016/j.rcim.2008.03.016

[4] H. I. Bozma, H. Yalçin, Visual processing and classification of items on a moving conveyor: a selective perception approach, Rob. and Comp.-Integ. Manuf 18,(2002) 125– 133.

DOI: 10.1016/s0736-5845(01)00035-7

[5] I. Rekleitis, D. Meger, G. Dudek, Simultaneous planning, localization, and mapping in camera sensor network, Robotics and Autonomous Systems 54 (2006) 921-932.

DOI: 10.1016/j.robot.2006.05.009

[6] G. Veiga, J.N. Pires, K. Nilsson, Experiments with service-oriened architectures for industrial robotic cells programming, Rob. and Comp.-Integ. Manuf , 25, (2009) 746-755.

DOI: 10.1016/j.rcim.2008.09.001

[7] B. Peeters, K. Peeters, Van der Auweraer, H. Olbrechts, T. Demeester, F. Wens, L., Experimental modal analysis using camera displacement measurements: a feasibility study , Proc.- SPIE the Int. Soc. for Opt. Engi., 5503 (2004) 298-309.

DOI: 10.1117/12.579867

[8] T. Schmidt , J. Tyson, J., K. Galanulis, Full-Field Dynamic Displacement and Strain Measurement Using Advanced 3D Image Correlation Photogrammetry, Experimental Techniques, Vol.27, 3(2003) 41-44.

DOI: 10.1111/j.1747-1567.2003.tb00115.x

[9] P. Synnergren , M. Sjödahl M.; A stereoscopic digital speckle photography system for 3-D displacement field measurements, Opt. and Las. in Eng., Vol.31, 6 (1999) 425-443.

DOI: 10.1016/s0143-8166(99)00040-8

[10] A. Zisserman , R. Hartley , Multiple view geometry in computer vision. New York, NY, USA: Cambridge University Press, 2004.

[11] P.Kohut, M.Giergiel, Optical 3D measurement of amplitude of vibrations, Polish Journal of Environmental Studies, vol.20 no.5A (2011) 61–65.

[12] P. Kohut, P. Kurowski Application of modal analysis supported by 3D vision-based measurements, Journal of Theoretical and Applied Mechanics ; vol. 47 4 (2009) 855–870.

[13] P. Kohut, P. Kurowski, The Integration of Vision System and Modal Analysis for SHM Application, A Conf. & Exp. on Struc. Dyn., IMAC XXIV, St. Louis (2006) 8.

[14] B. Jahne , Digital image processing: concepts, algorithms, and scientific application, Springer-Verlag, Berlin, 1995.

[15] P. Kohut, T. Uhl, Application of the visual servoing for an active vibration control system, in Robot control 2003 , A Proc. volume from the 7th IFAC Symposium, I.Duleba, J.Sasiadek (Eds.), Elsevier IFAC Publication, 1 (2003) 165-170.

DOI: 10.1016/s1474-6670(17)33387-6

[16] R.C Gonzales , R.E Woods, Digital Image processing, Prentices Hall, 2008.

[17] G. Bradski, A. Kaehler, Learning OpenCV , O'Reilly Media, Sebastopol 2008.

[18] M. Giergiel, T. Buratowski, P. Małka, K. Kurc, P. Kohut, K. Majkut, The Project of Tank Inspection Robot, in Struc. H. Mon. II ,T Uhl (Eds.), Key Eng. Mat.518 (2012) 375-384.

DOI: 10.4028/www.scientific.net/kem.518.375

[19] P. Kohut, Prototyping of visual servoing systems using signal processors, Ph.D. Thesis, AGH, Krakow, 2002.

[20] P. Kurowski P., T. Uhl , VIOMA 2.0 – users guide, Dept of Robotics and Machine Dynamics AGH, Krakow 2003.

[21] Y. Ma , S. Soatto, J. Kostecka, S. Sastry, An invitation to 3D Vision. Springer-Verlag, New York, 2004.

[22] C. Poelman, T. Kanade , A paraperspective factorizarion method for shape and motion recovery, IEEE Trans. on Pattern An. and Mach. Intellig., March, 19(3) (1997) 206–218.

DOI: 10.1109/34.584098

[23] C. Tomasi, T. Kanade, Detection and Tracking of Point Features, Carnegie Mellon University, Technical Report, CMU-CS-91-132, Pittsburgh, PA, USA, 1991.