Extraction Algorithm of Lip Characteristic Parameters Based on Interpolation

Abstract:

In the research of identity recognition based on lip motion features, there are limitations for the existing algorithms of lip characteristic parameters extraction. This paper uses the strategy of lip static/dynamic geometric features fusion, designs the lip feature parameter extraction program based on interpolation, and implements the major aspects of processing algorithm of the program. The solution is based on the speaker's key six primitives spelling lip sequence image, firstly generates the lip key point coordinates in the image, then based on Lagrange interpolation obtains function curve coefficient of upper and lower lips' key points , lastly the two curve coefficients are combined to form lip motion feature information of human speaker's some specific sounds; Simulation results show that the extraction of characteristic parameters of the program not only have a high efficiency and availability, but also have the advantages of good storage.

• Periodical: Applied Mechanics and Materials (Volumes 536-537)
• Pages: 235-240
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.536-537.235
• Online since: April 2014
• Authors: Ying Jie Meng, Li Xin Bai*, Wen Jun Liu, Ming Wen Liu
• Keywords: Feature Extraction, Interpolation, Lip Motion

References

[1] Çetingül. H. Ertan, Yücel. Yemez1, Erzin. Engin, Tekalp.A. Murat. Discriminative analysis of lip motion features for speaker identification and speech-reading. IEEE Transactions on Image Processing, v 15, n 10, pp.2879-2891, October (2006).

DOI: 10.1109/tip.2006.877528

[2] J. Luettin, N. A. Thacker. Speechreading Using Probabilistic Models. Computer Vision and Image Understanding, 65(2): 163-178, February (1997).

DOI: 10.1006/cviu.1996.0570

[3] G. I. Chiou, J. N. Hwang. Lipreading by Using Snakes. Principal Component Analysis and Hidden Markov Models to Recognize Color Motion Video. IEEE Trans. on Image Processing, 6(8): 1192-1195, (1997).

DOI: 10.1109/83.605417

[4] T.F. Cootes, C.J. Taylor. A Mixture Model for Representing Shape Variation. Image and Vision Computing, 17(8): 567-574, (1999).

DOI: 10.1016/s0262-8856(98)00175-9

[5] Li Meng, Cheung Yiu-Ming. A Novel Motion Based Lip Feature Extraction for Lip-reading. Proceedings - 2008 International Conference on Computational Intelligence and Security, CIS 2008, v 1, pp.361-365, (2008).

DOI: 10.1109/cis.2008.214

[6] LIJing , ZHENG Fang , ZHANGJiyong , WUWenhu. Context dependent initial final acoustic modeling for continuous Chinese speech recognition [J]. TsinghuaUniv Sci & Tech, 2004, 44(1): 61-64.

[7] CannyJ. AComputationalApproachtoEdgeDetection[J]. IEEE TransonPAMI, 1986, 8(6): 6792698.

[8] Meng Yingjie, Li Zhaoxia, Hu Yingjie, et al. Speaker identification based on feature mouth shapes [J]. Journal of Information and Computational Science, 2009, 6: 1209-1216.

[9] Meng Yingjie, Hu Yingjie, Zhang Haiyan, et al. Feature mouth shapes extraction based on contour of internal lips[C/CD]. WiCOM2010: proceedings of the 6th International Conference on Wireless Communications, Networking and Mobile Computing, Chengdu, China, Sept. 23-25, 2010. IEEE Computer Society.

DOI: 10.1109/wicom.2010.5600687

[10] Wang Wei. Identification research based on dynamic feature mouth shapes[Master's thesis]. Lanzhou: Lanzhou University, (2008).

[11] Meng Yingjie, Zhang Haiyan, Hu Yingjie, Li Jinyang. Lip Information Extraction Based on the Fusion of Geometry and Motion Features[A]. 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD)[C]. 2011. 2186-2190.

DOI: 10.1109/fskd.2011.6019998