Design and Implementation of a Cache System in Web Search Engines

Hong Yuan Ma

doi:10.4028/www.scientific.net/AMM.462-463.1106

Paper Titles

Architecture Model of FMS Based on Multi-Agent Technology
p.1087

Study of the Establishment of a Local Fitness Network System Platform
p.1093

The Technology of Software Reliability Virtual Test Based on Software Conventional Failure Data
p.1097

A Method of Numbered STL File Format for Recording Data
p.1102

Design and Implementation of a Cache System in Web Search Engines
p.1106

A Method of Pepper Plant Modeling and Animation Set-Up in Autodesk Maya
p.1110

Research on Security Algorithm for Crossing Heterogeneous Network Based on Unified Communication Technology
p.1118

Design and Realization of Music Player Based on Android System
p.1123

Design on HEVC Streaming Media Player Based for Android
p.1127

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vols. 462-463Design and Implementation of a Cache System in Web...

Design and Implementation of a Cache System in Web Search Engines

Abstract:

Web search engine caches the results which is frequently queried by users. It is an effective approach to improve the efficiency of Web search engines. In this paper, we give some valuable experience in our design and implementation of a Web search engine cache system. We present there design principles: logical layer processing, event-based communication architecture and avoiding frequent data copy. We also introduce the architecture presented in practice, including connection processor, application processor, query results caching processor, inverted list caching processor and list intersection caching processor. Experiments are conducted in our cache system using a real Web search engine query log.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volumes 462-463)

Pages:

1106-1109

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.462-463.1106

Citation:

Cite this paper

Online since:

November 2013

Authors:

Hong Yuan Ma*

Keywords:

Cache System, Information Retrieval, Information Storage, Web Search Engines

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] T. Fagni, R. Perego, F. Silvestri, et al.: Boosting the performance of Web search engines:　Caching and prefetching query results by exploiting historical usage data. ACM Trans on Information System, Vol. 24(1): 51-78 (2006).

DOI: 10.1145/1125857.1125859

Google Scholar

[2] R. Baeza-Yates, A. Gionis, F. Junqueira, et al.: Design trade-offs for search engine caching. ACM Trans on WEB, Vol. 2(4): 1–28 (2008).

DOI: 10.1145/1409220.1409223

Google Scholar

[3] F.B. Sazoglu, B. B Cambazoglu, R Ozcan, et al.: A financial cost metric for result caching. In the proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (2013).

DOI: 10.1145/2484028.2484182

Google Scholar

[4] Information on http: /www. kegel. com/c10k. html.

Google Scholar