Research and Implementation of LED Optical Design Focused Web Crawler

Guo Chao Liang; Cai Feng Cao

doi:10.4028/www.scientific.net/AMM.543-547.2941

Paper Titles

Analysis and Research of Web Database Interface Performance
p.2924

The Research on Software Reuse Technology
p.2929

Automatic Classification Method of Web Services in Cloud Environment
p.2933

University Heterogeneous Data Source Integration Middleware Design Based on XML
p.2937

Research and Implementation of LED Optical Design Focused Web Crawler
p.2941

An Implement Scheme of Persistence Layer Based on Hibernate
p.2945

A Performance-Based Policy for Job Assignment under Distributed Rendering Environments
p.2949

Research on Java Development Kit Based on Complex Networks
p.2953

Research and Design of Web Crawler for Music Resources Finding
p.2957

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vols. 543-547Research and Implementation of LED Optical Design...

Research and Implementation of LED Optical Design Focused Web Crawler

Abstract:

The LED optical design focused web crawler is proposed based on Shark-Search and topical dictionary. Then the crawling strategy is implemented by extending the web crawler Heritrix. The experimental results show that the design scheme (Topic-First) and its web crawler LED-Crawler can effectively capture the LED optical design relevant web pages. And compared to general search engines, LED-Crawler can improve the accuracy.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volumes 543-547)

Pages:

2941-2944

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.543-547.2941

Citation:

Cite this paper

Online since:

March 2014

Authors:

Guo Chao Liang*, Cai Feng Cao

Keywords:

Focused Crawler, Heritrix, LED Optical Design, Shark-Search Algorithm

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] P.M.E. De Bra, R.D.J. Post: Information retrieval in the World-Wide Web: making client-based searching feasible. Computer Networks and ISDN Systems. Vol. 27 (1994)， pp.183-192.

DOI: 10.1016/0169-7552(94)90132-5

Google Scholar

[2] Michael Hersovici, Michal Jacovi, Yoelle S. Maarek, Dan Pelleg, Menachem Shtalhaim, Sigalit Ur: The shark-search algorithm. An application: tailored Web site mapping. Computer Networks and ISDN Systems. Vol. 30 (1998), pp.317-326.

DOI: 10.1016/s0169-7552(98)00038-5

Google Scholar

[3] Zhang Hang: The Design and Implementation of Wood Vertical Search Engine (2012).

Google Scholar

[4] Yang Renguang, Song Yu, Meng Xiangzeng: Multimedia topic search algorithm based on improved Shark-Search. Computer Engineering and Applications. Vol. 46 (2010), pp.152-154.

Google Scholar

[5] Qiu Zhe, Fu Taotao, Wang Xuesong: To develop its own search engine- Lucene + Heritrix (Second Edition), POST & TELECOM PRESS (2010).

Google Scholar