A Prototype for the Creation and Interactive Visualization of 3D Human Face Models

Abstract:

This paper presents a complete solution for the creation and manipulation of the 3D representationof a human face model using off the shelf components. First, the 3D model is obtained bymeans of a structured light system that is calibrated using only the vanishing points extracted from asimple planar surface. Then, an immersive interaction technique is used to manipulate the 3D model.The interaction tool is located in 3D space using a fuzzy technique with the advantages of a lowmemory usage, real-time operation and low positioning errors as compared to classical solutions. Experimentalresults including accuracy evaluation of the reconstruction and of the interaction tool arepresented. The resulting system can find applications in expression based human-computer interaction,virtual assisted cosmetic surgery, as well as in the teleconferencing, being in line with the currenttrends of intelligent user interfaces.

• Periodical: Advanced Engineering Forum (Volumes 8-9)
• Pages: 45-54
• DOI: https://doi.org/10.4028/www.scientific.net/AEF.8-9.45
• Online since: June 2013
• Authors: Radu Orghidan, Mihaela Gordan, Marius Danciu, Aurel Vlaicu
• Keywords: 3D Reconstruction, Immersive Interaction, Self-Calibration, Structured Light, Vanishing Points

References

[1] J. Salvi, S. Fernandez, T. Pribanic, and X. Llado. A state of the art in structured light patterns for surface profilometry. Pattern Recognition, 43(8): 2666-2680, (2010).

DOI: 10.1016/j.patcog.2010.03.004

[2] X. Zhang and L. Zhu. Projector calibration from the camera image point of view. Optical Engineering, 48: 117-208, (2009).

[3] M. Kimura, M. Mochimary, and T. Kanade. Projector calibration using arbitrary planes and calibrated camera. CVPR, (2007).

DOI: 10.1109/cvpr.2007.383477

[4] Ivan Martynov, Joni-Kristian Kämäräinen, and Lasse Lensu. Projector calibration by inverse camera calibration,. In Scandinavian Conf. on Image Analysis (SCIA), (2011).

DOI: 10.1007/978-3-642-21227-7_50

[5] J.P. Tardif. Non-iterative approach for fast and accurate vanishing point detection. IEEE 12th International Conference on Computer Vision, pages 1250-1257, (2009).

DOI: 10.1109/iccv.2009.5459328

[6] R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision - 2nd Edition. Cambridge University Press, (2004).

[7] E. Guillou, D. Meneveaux, E. Maisel, and K. Bouatouch. Using vanishing points for camera calibration and coarse 3D reconstruction from a single image. The Visual Computer, 16: 396- 410, (2000).

DOI: 10.1007/pl00013394

[8] Carsten Rother. A new approach for vanishing point detection in architectural environments. Journal Image and Vision Computing (IVC; Special Issue on BMVC 2000), vol. 20, no. 9-10: 647- -656, January (2002).

DOI: 10.1016/s0262-8856(02)00054-9

[9] J. Kogecka and W. Zhang. Efficient computation of vanishing points. IEEE International Conference on Robotics and Automation, 1: 223-228, (2002).

DOI: 10.1109/robot.2002.1013365

[10] Michael Bosse, Richard Rikoski, John Leonard, and Seth Teller. Vanishing points and threedimensional lines from omni-directional video. The Visual Computer, 19: 417-430, (2003).

DOI: 10.1007/s00371-003-0205-3

[11] D.A. Bowman, E. Kruijff, J. J. Jr. LaViola, and I. Poupyrev. Anintroduction to 3d user interface design. Computer Science, Virginia Tech., pages 96-108, (2001).

[12] C. Gratzel, T. Fong, S. Grange, and C. Baur. A non-contact mouse for surgeon computer interaction. Technology and Health Care Journal, IOS Press, 12, (2004).

DOI: 10.3233/thc-2004-12304

[13] C. Feied,M. Gillam, J. Wachs, J. Handler, H. Stern, andM. Smith. A real-time gesture interface for hands-free control of electronic medical records. AMIA Annual Symposium Proceedings, Washington, DC, USA, (2006).

DOI: 10.1007/978-3-540-36266-1_15

[14] L. Gallo andM. Ciampi. Wii remote-enhanced hand-computer interaction for 3d medical image analysis. Current Trends in Information Technology (CTIT), International Conference, pages 85- -90, (2009).

DOI: 10.1109/ctit.2009.5423137

[15] L. Paolis, M. Pulimeno, and G. Aloisio. Advanced visualization and interaction systems for surgical pre-operative planning. Journal of Computing and Information Technology, vol. 18, no 4, pp.385-392, 2010, 18, no 4: 385-392, (2010).

DOI: 10.2498/cit.1001878

[16] J. R. Cooperstock and G. Wang. Stereoscopic display technologies, interaction paradigms, and rendering approaches for neurosurgical visualization. In Stereoscopic Displays and Applications, San Jose, CA, USA, (2009).

DOI: 10.1117/12.808350

[17] B. Reitinger, A. Bornik, R. Beichel, and D. Schmalstieg. Liver surgery planning using virtual reality. IEEE Computer Graphics and Applications, 26, no. 6: 36-47, (2006).

DOI: 10.1109/mcg.2006.131

[18] R. I. Hartley and R. Kaucic. Sensitivity of calibration to principal point position. In Proc. Seventh European Conference on Computer Vision, pages 433-446. Springer, (2000).

DOI: 10.1007/3-540-47967-8_29

[19] Rahul Sukthankar, Robert G. Stockton, andMatthew D. Mullin. Smarter presentations: Exploiting homography in camera-projector systems. Proceedings of International Conference on Computer Vision, 1: 247-253, (2001).

DOI: 10.1109/iccv.2001.937525

[20] J. Pages and J. Salvi. A new optimised de bruijn coding strategy for structured light patterns. 17th International Conference on Pattern Recognition, 4: 284-287, (2004).

DOI: 10.1109/icpr.2004.1333759

[21] L. Zhang, B. Curless, and S. M. Seitz. Rapid shape acquisition using color structured light and multi-pass dynamic programming. Proceedings of the 1st International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), pages 24-36, (2001).

DOI: 10.1109/tdpvt.2002.1024035

[22] R. Orghidan, M. Danciu, A. Vlaicu, G. Oltean, M. Gordan, and C. Florea. Fuzzy versus crisp stereo calibration: a comparative study. Image and Signal Processing and Analysis (ISPA), 2011 7th International Symposium on, pages 627-632, (2011).