Design and Implementation of Full-Text Retrieval System for People’s Daily Annotated Corpus

Yang Sen Zhang; Gai Juan Huang

doi:10.4028/www.scientific.net/AMM.135-136.369

Paper Titles

Carbon Dioxide Gas Sensor Using SAW Device Based on ZnO Film
p.347

Characteristics of Yichun Late Triassic - Early Jurassic Monzogranite
p.353

Current Situation Analysis and Strategy Research of Environmental Protection Equipment Industry in China
p.359

Depositional Patterns of Dominant Sedimentary Time Units’ Reservoir in Daqing Oilfield
p.365

Design and Implementation of Full-Text Retrieval System for People’s Daily Annotated Corpus
p.369

Design and Implementation of VSP Seismic Data Acquisition System Based on Virtual Instrument Technology
p.375

Design and Optimization of Microwave Frequency Synthesizer Based on DDS
p.380

Design and Realization of Multi-Stage Traffic Signal Controller of Variable Phase
p.389

Design of Embedded Bio-Impedance Analyzer Based on Digital Auto Balancing Bridge Method
p.396

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vols. 135-136Design and Implementation of Full-Text Retrieval...

Design and Implementation of Full-Text Retrieval System for People’s Daily Annotated Corpus

Abstract:

In this paper, we have designed and realized a efficient full-text retrieval system for the basic annotation People's Daily Corpus based on the inverted index technology. According to the characteristics of the basic annotation People’s Daily Corpus data, we have analyzed the methods and strategies of system implementing thoroughly. On the basis of comparing the various schemes, we have put forward to the three levels index structure of Chinese character, word and address set, and given the design approach of each level index dictionary structure. After converting the unstructured People’s Daily corpus into index structured data, we realized the full-text search algorithm correspond to the proposed index structure. Experimental results show that the proposed search algorithm has achieved the target of "ten millions Chinese characters, response in a second", improved the speed of the People's Daily Corpus full-text search.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volumes 135-136)

Pages:

369-374

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.135-136.369

Citation:

Cite this paper

Online since:

October 2011

Authors:

Yang Sen Zhang, Gai Juan Huang

Keywords:

Full-Text Search, Inverted Index Technology, Query, Three Levels Index Structure

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] Long Haiyan, Huo Yuejun. Database query optimization [J]. Computer Knowledge and Technology, 2003(1): 8-9. (Chinese).

Google Scholar

[2] Lang Xiaowei, Wang Shenkang. Research and development of full-text retrieval system based on Lucene[J]. Computer Engineering, 2006(4): 94-99. (Chinese).

Google Scholar

[3] Su YingTan, Guo Xianyong, Jin xin. Chinese text retrieval system based Lucene [J]. Computer Engineering, 2007(23): 94-96. (Chinese).

Google Scholar

[4] Chen Aitao , He Jianzhang , Xu Liangjie , Fredric C. Gey , Jason Meggs, Chinese text retrieval without using a dictionary, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, 1997, July 27-31: 42-49.

DOI: 10.1145/258525.258532

Google Scholar