Overview of Chinese Word Segmentation Method

Abstract:

This article provides a brief introduction to Natural Language Processing and basic knowledge of Chinese Word Segmentation at first. Chinese Word Segmentation is a process of turning a series of Chinese characters into a series of Chinese words with some rules. As the fundamental component of Chinese information processing, it is wildly used in correlative areas. Accordingly, research on Chinese Word Segmentation has important theoretic and realistic meaning. In this paper, we mainly introduces the challenge in Chinese Word Segmentation, and presented the categories of Chinese Word Segmentation method.

• Periodical: Applied Mechanics and Materials (Volumes 427-429)
• Pages: 2568-2571
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.427-429.2568
• Online since: September 2013
• Authors: Shu Xian Liu*, Xiao Hua Li
• Keywords: Chinese Word Segmentation (CWS), Method, Natural Language Processing (NLP)

References

[1] Yimamu' aishan & Abudoulikemu, The Research and Application of the Chinese Machinery Word Segmentation Algorithm Based on Improved PATRICIA Tree Dictionary, 2010 2nd International Conference on Signal Processing Systems (ICSPS), Vol. 3, pp.341-345. (2010).

DOI: 10.1109/icsps.2010.5555788

[2] Zimin Wu, Gwyneth Tseng. ACTS: An automatic Chinese text segmentation system for full text retrieval. Journal of the American Society for Information Science, Vol. 46, Issue 2, pp.83-96. (1995).

DOI: 10.1002/(sici)1097-4571(199503)46:2<83::aid-asi2>3.0.co;2-0

[3] Ye Jiping & Zhang Guizhu, Research and improvement of Chinese word segmentation dictionary, Computer Engineering and Applications, Vol. 48, No. 23, pp.139-142. (2012).

[4] Ye Junmin, Li Songsong, Hao Guangquan, etc, The Prefix and Suffix Query of Chinese Word Segmentation Algorithm for Maximum Matching, Image Analysis and Signal Processing (IASP), 2011 International Conference on Digital Object Identifier, pp.74-77. (2011).

DOI: 10.1109/iasp.2011.6109001

[5] Fu Jianhui, Cao Cungen, Wang Shi, Approach to Recognizing Chinese Metaphorical Phrases Based on Distinction Words, Computer Science, Vol. 37, No. 10. (2010).

[6] Ma Yongliang, Zhao Tiejun, Combining Multiple Chinese Word Segmentation Results for Statistical Machine Translation, JOURNAL OF CHINESE INFORMATION PROCESSING, Vol. 24, No. 1, pp.104-109. (2010).

[7] Wang Xijie, Quantitative analysis of effective range of context in Chinese word segmentation based on word-position tagging, Journal of Computer Applications, Vol. 32, No. 5, pp.1340-1342, 1346. (2012).

DOI: 10.3724/sp.j.1087.2012.01340

[8] YU Jiangde, WANG Xijie, FAN Xiaozhong, Which is More Effective for Chinese Lexical Analysis via Character Tagging: Above-context Versus Below-context, Computer Science, Vol. 39 , No. 11, pp.201-203. (2012).