Research and Application on Optimization of Multi-Thread Download Technology for Enhanced Search Engine

Ya Juan Sun; Hong Lin; Bao Hui Wang

doi:10.4028/www.scientific.net/AMR.756-759.1008

Paper Titles

Research and Application on Information Resources Planning for University
p.988

Research and Application on Technical Implementation Architecture in University Informatization Planning
p.993

The Application of Network Anomaly Mining Technology in Campus Network Information Security
p.998

A Validity Study on the Electronic Commerce Mode and Informatization Construction in the Perspective of Value Chain
p.1003

Research and Application on Optimization of Multi-Thread Download Technology for Enhanced Search Engine
p.1008

Mail Filtering Algorithm Based on the Feedback Correction Probability Learning
p.1013

Design and Application of the Network Distance Teaching System
p.1017

Research and Implementation of Key RFID Technology in Poultry Products Traceability System
p.1021

The Design and Implement of the Safety Production Management & Quality Trace System for Poultry
p.1026

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 756-759Research and Application on Optimization of...

Research and Application on Optimization of Multi-Thread Download Technology for Enhanced Search Engine

Abstract:

Multi-threaded file download as the key technology of content acquisition system for search engine, determines the efficiency and timeliness of content acquisition. In this paper, we do the research on optimization technologies which include multithreaded download based on P2SP, task scheduling based on MapReduce and download based on the protocol adaptation, designed to improve enhanced search engine efficiency. At last the result shows that the optimization method is successful for content acquisition.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 756-759)

Pages:

1008-1012

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.756-759.1008

Citation:

Cite this paper

Online since:

September 2013

Authors:

Ya Juan Sun, Hong Lin, Bao Hui Wang

Keywords:

MapReduce, Multi-Threaded Download, P2SP, Protocol Adaptation, Search Engine

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] G.L. Wang, Application Research and program optimization for MongoDB database, China Science and technology information, 2011, vol 20, pp.93-94.

Google Scholar

[2] F. Hou, Download System Analysis Based on the P2SP Technology – Example as thunder, Journal of Henan College of Finance＆ Taxatio, Nov. 2011, vol. 25, pp.88-89.

Google Scholar

[3] G.Z. Sun, F. Xiao, X. Xiong, Study on Scheduling and fault tolerance mechanism of MapReduce, Microelectronics and computer, 2007, vol. 24, pp.178-179.

Google Scholar

[4] D. Hu, H. Liu, The Video Technology on Internet Based on RTP/RTCP, Computer Application Research, 2002, vol. 10, pp.140-142.

Google Scholar