Mixed Reality as a Tool Supporting Programming of the Robot

Abstract:

Mixed reality is a term which covers a wide range of computer and real world interaction. This name refers to the picture shown on the display device, which consists of real and virtual elements. These elements are mixed in some proportion, so we may distinguish between augmented reality (where the real world dominates) and augmented virtuality (where the virtual world dominates). In most of cases a flat (2D) live image is processed, which makes this technology available in smartphones, car navigation systems etc. In the engineers world the mixed reality is used mainly in simulators and trainers, but also as supporting technology during manufacturing, assembly or maintenance process. This paper discuss different approach: mixed reality as a tool supporting programming of the robot. The main goal was to reproduce a path given by operator in off-line programming software using the visual representation of a real object. The system should be regarded as experimental one, because of early stage of development. It allows defining the coordinates of discrete points or to discretize the path and save this data for further processing. The operator should care the rest of programming task, but the use of the robot is reduced to minimum at this stage. The major disadvantages of the mentioned method are problems with accuracy and the invariable orientation of the tool used by the robot during the process they may be eliminated by using better video equipment and the specialized image processing routine. This paper presents the main assumptions of the method along with a possible solution of the problem.

• Periodical: Advanced Materials Research (Volume 1036)
• Pages: 737-742
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.1036.737
• Online since: October 2014
• Authors: Krzysztof Foit*
• Keywords: Augmented Reality, Mixed Reality, Programming, Robot, Robotics

References

[1] P. Milgram, F. Kishino, A taxonomy of mixed reality visual displays, IEICE TRANSACTIONS on Information and Systems 77. 12 (1994), pp.1321-1329.

[2] R. Freeman, A. Steed, B. Zhou, Rapid Scene Modelling, Registration and Specification for Mixed Reality Systems, Proceedings of ACM Virtual Reality Software and Technology, pp.147-150, Monterey, California, November (2005).

DOI: 10.1145/1101616.1101647

[3] M. Bajura, H. Fuchs, R. Ohbuchi, Merging virtual objects with the real world: Seeing ultrasound imagery within the patient, ACM SIGGRAPH Computer Graphics, Vol. 26, No. 2, pp.203-210. ACM July (1992).

DOI: 10.1145/142920.134061

[4] G. M. Stratton, (1896). Some preliminary experiments on vision without inversion of the retinal image. Psychological Review, 3(6) (1896), p.611.

DOI: 10.1037/h0072918

[5] G. M. Stratton, Vision without inversion of the retinal image. Psychological review, 4(4) (1897), p.341.

[6] H.V. Helmholtz, Treatise on physiological optics, vol. III (1867), trans. and ed. JPC Southall.

[7] J. Świder, K. Foit, G. Wszołek, D. Mastrowski, The system for simulation and off-line, remote programming of the Mitsubishi Movemaster RV-M1 robot, J. Achiev. Mater. Manuf. Eng. 2007 vol. 25 iss. 1, pp.7-14.

[8] K. Foit, J. Świder, D. Mastrowski, The project of an off-line, remote programming system for Mitsubishi Movemaster industrial robot, Machine-building and technosphere on the border of the XXI century, XIII International scientific and technological conference, Donetsk-Sewastopol, 2006. T. 4. [B. m. ] : [b. w. ], 2006, pp.252-255.

[9] K. Foit, Controlling the movement of the robot's effector on the plane using the SVG markup language, Modern technologies in industrial engineering. Ed. by C. Carausu [et al. ], Staffa-Zurich : Trans Tech Publications, 2014, pp.577-581.

DOI: 10.4028/www.scientific.net/amr.837.577

[10] Mitsubishi RV-M1 User's Manual, Mitsubishi Electric Co.

[11] P. Fiertek, K. Olejnik, Three-dimensional tube sheet position assigning in robot's working space (in Polish), Prace Naukowe Politechniki Warszawskiej, Elektronika, 2008, pp.101-110.

[12] P. Fiertek, Machine vision for the heat exchangers robotic welding station (in Polish), Postępy Robotyki, Sterowanie, percepcja i komunikacja, 381-390.

[13] G. C. Burdea, H. J. Wolfson, H. J., Solving jigsaw puzzles by a robot, Robotics and Automation, IEEE Transactions on, 5(6) 1989, pp.752-764.

DOI: 10.1109/70.88097

[14] A. C. Kak, G. N. DeSouza, Robotic vision: what happened to the visions of yesterday?. In Pattern Recognition, 2002, Proceedings of 16th International Conference on (Vol. 2, pp.839-847), IEEE.

DOI: 10.1109/icpr.2002.1048433