Study of Distributed Personalized Search Engine

Article Preview

Abstract:

Combining distributed computing and data mining techniques, a distributed personalized search engine is put forward to solve the the problems current search engines faced. It has described the theoretical model and algorithmic processing. Under the Hadoop, a distributed platform processing information with Java, the key parts are programmed and implemented. The experimental results show that this theoretical model can improve the accuracy and speed of the user's queries so it can improve the retrieval performance of the search engine.

You might also be interested in these eBooks

Info:

Periodical:

Advanced Materials Research (Volumes 756-759)

Pages:

1035-1039

Citation:

Online since:

September 2013

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2013 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] G.E. Dupret and B. Piwowarski. A user browsing model to predict search engine click data from past observations. In SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, 2008, 331–338.

DOI: 10.1145/1390334.1390392

Google Scholar

[2] WANG Yi-Jie, SUN Wei-Dong, ZHOU Song, PEI Xiao-Qiang, LI Xiao-Yong. Key technologies of distributed storage for cloud computing[J]. Journal of Software, 2012, 23(4): 962−986.

DOI: 10.3724/sp.j.1001.2012.04175

Google Scholar

[3] XU Xiao, ZHANG Wei-Zhe, ZHANG Hong-Li, FANG Bin-Xing. WAN-Based distributed Web crawling[J]. Journal of Software, 2010, 21(5): 1067-1082.

DOI: 10.3724/sp.j.1001.2010.03725

Google Scholar

[4] Fu ZhongQian, Wang XinYue, Zhou PeiLing etc. Realization of intelligent body on network personalized information filter. Computer Application, 2000, 20(3): 26-29.

Google Scholar

[5] Hong Zhang, Yanhong Ma, Qiuyu Zhang. Research on intelligent personalized search engine. ICICT2006: 168~172.

Google Scholar

[6] WU Wen-Zhong, YI Ping. Application of Distributed Search Engine Based on MapReduce[J]. Computer Systems & Applications. 2012, 21(2): 249-250+251.

Google Scholar

[7] HU Yu, FENG Jun. Distributed Search Engine Using Hadoop[J]. Computer Systems & Applications. 2010. 19(7): 224-228.

Google Scholar

[8] H. B. Liu and V. Kešelj, Combined mining of web server logs and web contents for classifying user navigation patterns and predicting users' future requests, Data & Knowledge Engineering, 2007, 61(2): 304-330.

DOI: 10.1016/j.datak.2006.06.001

Google Scholar

[9] YANG Jing-jing; JU Shi-guang; WANG Xiu-hong. Research of individuation search engine based on web. Computer Engineering and Design, 2008, 29(20): 5206~5208.

Google Scholar

[10] Zhu Ming. Data Mining. Hefei: China Science & Technology University Press, 2002. 230~231.

Google Scholar

[11] Nils J. Nilsson writte. Zheng kougen etc. translate. Artificial intelligence. Beijing: Mechanical Industry Press, 2000. 277~281.

Google Scholar

[12] WANG Jun-sheng,SHI Yun-mei,ZHANG Yang-sen. Key technologies of distributed search engine based on Hadoop[J]. Journal of Beijing Information Science and Technology University, 2011, 26(4): 53-56+61.

Google Scholar