Chinese Word Segmentation Based on the First Kind of Spline Weight Function Neural Networks

Abstract:

With the continuous development of information technology, word segmentation technology becomes an important link in dealing with the increasing amount of information conveniently. Different from English word segmented by spaces, Chinese writing is continuous, and there is no space between words, this brings a lot of trouble to word segmentation. In this article, through the analysis of different property of words to get a code that can be used for training and combined it with the first kind of spline weight function neural network, then by training a large number of existing rules encoding to generate a study method that can divide the statement correctly.

• Periodical: Applied Mechanics and Materials (Volumes 513-517)
• Pages: 683-686
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.513-517.683
• Online since: February 2014
• Authors: Dai Yuan Zhang*, Yan Xu
• Keywords: Algorithm (GA), Chinese Word Segmentation, Neural Network (NN), Spline, Weight Function Neural Network

References

[1] Kai Ying L, Jia Heng Z. Research of automatic Chinese word segmentation[J]. Machine Learning and Cybernetics, 2002, (2): 805-809.

DOI: 10.1109/icmlc.2002.1174493

[2] Qian cao, Yan ding. Research of Chinese word segmentation and application in information retrieval [J]. Application Research of Computers, 2004, 24(5): 71-74.

[3] Lei Zhang, Daiyuan Zhang. Research of Chinese word segmentation algorithm [J]. Computer Knowledge and Technology, 2009, 5(1): 192-193.

[4] Jia he. Chinese word segmentation based on genetic algorithm optimization research [D]. Chengdu: University of electronic science and technology, (2012).

[5] Yue wang, Changxiu Cao. The causes of local minimum of the BP network analysis and the method to avoid [J]. Computer Engineering, 2002, 28(6): 35-36, 82.

[6] Daiyuan Zhang. Neural Network New Theory and Method [M]. Beijing: Tsinghua University Press, (2006).

[7] Daiyuan Zhang. A new kind of algorithm in spline weight function neural network [J]. Systems Engineering and Electronics, 2006, 28(9): 1434-1446.

[8] Ning R, Zhu G. The construction of a kind of rational spline[J]. Numerical Mathematics: A Journal of Chinese Universities, 1996, 2: 134-138.

[9] Greville T. N. Theory and applications of spline functions[M]. New York: Academic Press, 1969: 1-35.

[10] Dequan Zheng, Feng yu, Kaitao wang. A segmentation method based on the Chinese as a word.