The Research of 3D Mouth Animation Synthesis Driven by Continuous Chinese Text Based on Mpeg-4

Abstract:

A 3D human facial model was made based on the MPEG-4 standard. A method of synthesis of mouth animation based on a entire Chinese sentence was put forward, according to the influence of Chinese pronunciation rules such as co-articulation sufficiently. The method computes the extent of influence between current phoneme and the one next to it, and constructs the continuous mouth-shape sequence. Then filter the phoneme which has little effect on the last and the next one when pronouncing continuously. The 3D facial model was driven to synthesize smooth and realistic animation. After the experiments, it is proved that the method has a good versatility and reliability, which can be used on different kinds of 3D models. At the same time, the method can effectively improve the problem of co-articulation in continuous Chinese pronunciation, which makes the synthesis of mouth animation more smooth, more fluent, and more close to real pronunciation of people.

• Periodical: Applied Mechanics and Materials (Volumes 519-520)
• Pages: 477-484
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.519-520.477
• Online since: February 2014
• Authors: Yue Wang, Hui Jian Han*
• Keywords: 3D Mouth Animation, Co-Articulation, Driven by Continuous Chinese Text, MPEG-4

References

[1] Wei Zhou. Chinese Speech Synchronized Rea1istic 3D Facial Animation (In Chinese)[D]. Hefei: University of Science and Technology of China, (2008).

[2] Peng Du, Yu Fang, Qunfei Zhao. Face and Voice Synchronization Animation System Based on Chinese Text Drive (In Chinese)[J]. Computer Engineering, 2012(13): 260-262.

[3] Parke F I, Waters K. Computer Facial Animation[M]. Wellesley, MA: Peters A K, (1996).

[4] Ekman P, Friesen W V. Manual for the Facial Action Coding System[M]. Palo Alto CA: Consulting Psychologists Press, 1978: 1-45.

[5] Wasters K. A Muscle Model for Animation Three-Dimensional Facial Expression[J]. Computer Graphics, 1987, 2l(4): 17-24.

[6] Du Yangzhou, Lin Xueyin. Realistic Mouth Synthesis Based on Shape Appearance Dependence Mapping[J]. Pattern Recognition Letters, 2002(23): 1875-1885.

DOI: 10.1016/s0167-8655(02)00161-7

[7] Hong Pengyu, Wen Zhen, Thomas S H. Real-time Speech-driven Face Animation with Expressions Using Neural Networks[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13(4): 916-926.

DOI: 10.1109/tnn.2002.1021892

[8] Kai Wang. Research on 3D Facial Animation Synthesis Based on MPEG-4 (In Chinese)[D]. Beijing: Beijing University of Technology, (2009).

[9] Dalong Jiang, Zhaoqi Wang, Wen Gao. The Realization of 3-D Facial Animation Based on MPEG-4 (In Chinese) [J]. Journal of System Simulation, 2001, 13(1): 493-496.

DOI: 10.1109/simsym.2002.1000177

[10] Juan Lan, Yiqiang Chen, Yan Xu. A Facial Animation Synthesis Approach Based on MPEG-4 and PCA (In Chinese) [J]. Computer Engineering and Applications, 2004, 40(10): 60-64.