A New Parameterised Feature-Based Generic 3D Human Face Model for Emotional Bio-Robots

Abstract:

To represent various human facial expressions is an essential requirement for emotional bio-robots. The human expressions can convey certain emotions for communications of human beings with some muscles positions and their movements. To design and develop emotional robots, it is necessary to build a generic 3D human face model. While the geometrical features of human faces are freeform surfaces with complex properties, it is the fundamental requirement for the model to have the ability of representing both primitive and freeform surfaces. This requirement makes the Non-rational Uniform B-Spline (NURBS) are suitable for 3D human face modelling. In this paper, a new parameterised feature based generic 3D human face model is proposed and implemented. Based on observation of human face anatomy, the authors define thirty-four NURBS curve features and twenty-one NURBS surface features to represent the human facial components, such as eyebrows, eyes, nose and mouth etc. These curve models and surface models can be used to simulate different facial expressions by manipulating the control points of those NURBS features. Unlike the existing individual based face modelling methods, this parameterised 3D face model also gives users the ability to use the model imitate any face appearances. In addition the potential applications of the new proposed 3D face model are also discussed. Besides emotional bio-robots, it is believed that the proposed model can also be applied in other fields such as aesthetic plastic surgery simulation, film and computer game characters creation, and criminal investigation and prevention.

• Periodical: Applied Mechanics and Materials (Volume 461)
• Pages: 838-847
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.461.838
• Online since: November 2013
• Authors: Xu Zhang, Shu Jun Zhang, Kevin Hapeshi
• Keywords: Emotional Bio-Robots, Feature Based, Generic 3D Face Model, Parameterized

References

[1] Zhang S, Hapeshi K, Bhattacharya A K. 3D modelling of biological systems for biomimetics. Journal of Bionic Engineering, 2004, 1, 20-40.

DOI: 10.1007/bf03399451

[2] Hashimoto T, Hiramatsu S, Kobayashi H. Development of face robot for emotional communication between human and robot. Proceedings of IEEE International Conference on Mechatronics and Automation (ICMA 2006), Luoyang, China, 2006, 25-30.

DOI: 10.1109/icma.2006.257429

[3] Takahashi Y, Hatakeyama M, Kanno M. Experiments on human facial expressions for improvement of simplified robot face. Annual Conference SICE, Takamatsu, Japan, 2007, 480-483.

DOI: 10.1109/sice.2007.4421031

[4] Takahashi Y, Sato H. Compact robot face with simple mechanical components. Proceedings of International Conference on Control Automation and Systems (ICCAS 2010), Gyeonggi-do, South Korea, 2010, 2300-2303.

DOI: 10.1109/iccas.2010.5669867

[5] Waters K, Terzopoulos D. Modelling and animating faces using scanned data. The Journal of Visualization and Computer Animation, 1991, 2, 123-128.

DOI: 10.1002/vis.4340020405

[6] Yongli H, Mingquan Z, and Zhongke W. An automatic non-rigid point matching method for dense 3D face scans. Proceedings of International Conference on Computational Science and Its Applications (ICCSA 2009), Suwon, Korea, 2009, 215-221.

DOI: 10.1109/iccsa.2009.12

[7] Tognola G, Parazzini M, Svelto C, Ravazzani P, and Grandori F. A fast and reliable system for 3D surface acquisition and reconstruction. Image and Vision Computing, 2003, 21, 295-305.

DOI: 10.1016/s0262-8856(02)00160-9

[8] Guenter B, Grimm C, Malvar H, Wood D. Making faces. Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, Orlando, FL, USA, 1998, 55-66.

DOI: 10.1145/280814.280822

[9] Rydfalk M. CANDIDE, a parameterized face, PhD thesis, Linköping University, Linköping, Sweden, (1978).

[10] Ahlberg J. CANDIDE-3 – an updated parameterised face. Report No. LiTH-ISY-R-2326, Dept. of Electrical Engineering, Linköping University, Sweden, (2001).

[11] Welsh B. Model-based coding of videophone images. Electronics & Communication Engineering Journal, 1991, 3(1), 29-36.

[12] Mayer C, Wimmer M, Stulp F, Riaz Z, Roth A, Eggers M, Radig B. A real time system for model-based interpretation of the dynamics of facial expressions. Proceedings of 8th IEEE International Conference on Automatic Face & Gesture Recognition (FG'08), Amsterdam, Netherlands, 2008, 1-2.

DOI: 10.1109/afgr.2008.4813440

[13] Blanz V, Vetter T. A morphable model for the synthesis of 3D faces, Proceedings ofthe 26th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, USA, 1999, 187-194.

DOI: 10.1145/311535.311556

[14] Davies A, Ek C H, Dalton C, and Campbell N. Generating 3D morphable model parameters for facial tracking : factorising identity and expression, Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications (GRAPP/IVAPP '12), Rome, Italy, 2012, 309-318.

DOI: 10.5220/0003811403090318

[15] Au B L, Ly Q N, Minh H P. An individualized system for face ageing and facial expressions modeling based on 3D practical faces data. Proceedings of International Conference on Control, Automation and Information Sciences (ICCAIS), Saigon, Vietnam, 2012, 398-403.

DOI: 10.1109/iccais.2012.6466626

[16] Ahyoung S, Seong-Whan L, Bulthoff H, Wallraven C. A morphable 3D-model of Korean faces. Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (SMC), Seoul, Korea, 2012, 2283-2288.

DOI: 10.1109/icsmc.2012.6378081

[17] He Y, Qin H. Surface reconstruction with triangular b-splines. Proceedings of Geometric Modeling and Processing, Beijing, China, 2004, 279-287.

[18] Bézier P. Numerical control: mathematics and applications, John Wiley & Sons Ltd, London, (1972).

[19] Gordon W J, Riesenfeld R F. B-spline curves and surfaces, in: Barnhill R.E., Riesenfeld R. F, ed. Computer aided geometric design, Academic Press, Waltham, USA, 1974, 95-126.

DOI: 10.1016/b978-0-12-079050-0.50011-4

[20] Boor C D. On Calculating with B-Splines. Journal of Approximation Theory, 1972, 6, 50-62.

[21] Larrabee W F, Makielski K H, Henderson J L. Surgical anatomy of the face, Lippincott Williams & Wilkins, Philadelphia, USA, (2004).

[22] Rose E H. Aesthetic facial restoration. Lippincott-Raven, New York, USA, (1998).

[23] Sun N, Ayabe T, Nishizaki T. Efficient spline interpolation curve modeling. Proceedings of the 3rd International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Splendor Kaohsiung, Taiwan, 2007, 2, 59-62.

DOI: 10.1109/iihmsp.2007.4457653

[24] Hartley P J, Judd C J. Parametrization of Bézier-type b-spline curves and surfaces. Computer Aided Design, 1978, 10, 130-134.

DOI: 10.1016/0010-4485(78)90090-8

[25] Zhang X, Zhang S, Hapeshi K. A new method for face detection in colour images for emotional bio-robots. Science China Technological Sciences, 2010, 53, 2983-2988.

DOI: 10.1007/s11431-010-4132-z