Study on Focused Crawler's Application in Searching Petroleum News

Lei Sun; Min Bian

doi:10.4028/www.scientific.net/AMR.986-987.2131

Paper Titles

Research on the Convergence Trend of Power Communication Network
p.2108

Energy Saving Routing Protocol of Wireless Sensor Network by Using Particle Swarm Optimization Algorithm
p.2113

Analysis Research of Power GIS Thematic Application Based on Web Services Technology
p.2121

Research on Nuclear Power Station Video Conferencing System from “Standard Definition” to “High Definition”
p.2127

Study on Focused Crawler's Application in Searching Petroleum News
p.2131

Application of Virtualization Technology in Nuclear Power Plant
p.2135

Client-Side in Management System of Transmission Line Passage Protection Based on Android
p.2139

Performance Evaluation and Analysis of ZigBee Technology in Smart Grid
p.2143

Research and Application of Mobile Internet Technology in Power
p.2148

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 986-987Study on Focused Crawler's Application in...

Study on Focused Crawler's Application in Searching Petroleum News

Abstract:

The paper aims for the application of focused crawler in the petroleum news topic crawling, studies the related technologies of the focused crawler, and put forward a crawling engine strategy and review strategy on the petroleum news topics, adopt different extracting methods for different types of pages through web page classification, and design a corresponding link topic correlation calculating method for the crawling engine strategy; test and verify the above-mentioned crawling engine strategies through experiments, and the experimental results show that the strategy can greatly balance its accuracy and width for focused crawler.

You might also be interested in these eBooks

Energy Research and Power Engineering 2014

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 986-987)

Pages:

2131-2134

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.986-987.2131

Citation:

Cite this paper

Online since:

July 2014

Authors:

Lei Sun*, Min Bian

Keywords:

Crawling Strategy, Focused Crawler, HTML Content Extracting, Topic Correlation

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] Y.Q. Liu, S.P. Ma and T. Hong, in: The basic technology of search engine, edtied by Tsinghua University Press, Beijing, (2010. 7).

Google Scholar

[2] S. Chakrabarti, M. Berg and B. Dom, in: Focused crawling: a new approach to topic-specific web resource discovery, edtied by Computer Networks, 31(11): 1623-1640. (1999).

DOI: 10.1016/s1389-1286(99)00052-3

Google Scholar

[3] L.B. Ouyang, X.Y. Li and G.H. Li, in: Survey of searching strategies of web spiders, edtied by Mini-Micro Computer Systems, 26(4): 703-706. (2005).

Google Scholar

[4] D.S. Li, in: Research of topic search engine: (a master's degree thesis), edtied by Harbin Engineering University, Harbin , (2005).

Google Scholar

[5] L.Z. Zhou and L. Lin, in: Survey on the research of focused crawling technique, 25(9): 1965-1969. (2005).

Google Scholar

[6] J.H. Liu and Y.L. Lu, in: Survey on topic - focused web crawler, edtied by Application Research of Computers , 24(10): 26-29. ( 2007).

Google Scholar

[7] P. Debra and R. Post, in: Information retrieval in the World-Wide Web: making client-based searching feasible, edtied by Computer Networks and ISDN Systems, 27(2): 183-192. (1994).

DOI: 10.1016/0169-7552(94)90132-5

Google Scholar