Research on Words Segmentation Technology in Chinese Full Text Retrieval System

Chang Liu

doi:10.4028/www.scientific.net/AMM.411-414.313

Paper Titles

Comparison of Mel Frequency Ceptrum Coefficient and Perceptual Linear Predictive in Perceptual Measurement of Chinese Initials
p.291

Corpus-Based Study on the Explicitation Strategies in Political Text Translation
p.298

The Statistical Analysis for the Structure of Modern Tibetan Initials and Finals
p.302

Research on Tibetan Language Synthesis System Front-End Text Processing Technology Based on HMM
p.308

Research on Words Segmentation Technology in Chinese Full Text Retrieval System
p.313

Research and Design of the MicroBlog Content Processing System Based on Integration of Internet of Things and Social Media
p.317

Statistical Analysis for Standard Chinese Syllables and Phoneme System
p.322

The Analysis of Typical Algorithms Based on K-Anonymity
p.327

Influencing Factors of the Villager Satisfaction with Village Committee Based on Factor Analysis: Evidence from Shaanxi, China
p.331

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vols. 411-414Research on Words Segmentation Technology in...

Research on Words Segmentation Technology in Chinese Full Text Retrieval System

Abstract:

In order to improve the speed of Chinese full-text retrieval in the premise of ensuring Chinese ambiguity inclusion and length limitation, this paper introduces the application methods of Chinese full-text retrieval system and the current application situation of Chinese word segmentation technology. Based on the existed word segmentation algorithms, this paper proposed an improved Chinese word segmentation algorithm. In the proposed method, the procedure of indexing is to construct the map between the relative words in the context and the dictionary. This paper improves the diction to realize better mapping with relative words, so as to realize Chinese words segmentation. The experiments demonstrate that the proposed Chinese full-text words segmentation algorithm is more effective than the existing methods.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volumes 411-414)

Pages:

313-316

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.411-414.313

Citation:

Cite this paper

Online since:

September 2013

Authors:

Chang Liu

Keywords:

Chinese Full-Text Retrieval System, Chinese Words Segmentation, Word Index

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] LIU Jian, WEI Cheng. Arithmetic Research on Chinese Segmentation[J]. Microcomputer Applications, 2008, 29（8）：11-16.

Google Scholar

[2] ZHANG Lei, ZHANG Dai-yuan. Chinese Lexical Analysis Algorithm[J]. Computer Knowledge and Technology, 2009（1）: 192-193.

Google Scholar

[3] SUN Tie-li, LIU Yan-ji. State of the Art and Difficulties in Chinese Word Segmentation Technology[J]. Information Technology, 2009(7): 187-189, 192.

Google Scholar

[4] ZHOU Cheng-yuan, ZHU Min, YANG Yun. Research on Chinese Word Segmentation Algorithm Based on the Dictionary[J]. Computer & Digital Engineering, 2009(03): 68-71, 87.

Google Scholar

[5] WU Jing-jing, JING Ji-wu, NIE Xiao-feng, et al. Fast Dictionary Mechanism for Chinese Word Segmentation[J]. Journal of the Graduate School of the Chinese Academy of Sciences, 2009, 26(5): 703-711.

Google Scholar

[6] XIONG Quan-hao. Overview of Chinese Word Segmentation[J]. Science Mosaic, 2009(11): 222-225.

Google Scholar