A Improved Topics Search Algorithm Based on PSO Strategy for Web Mining
HITS algorithm assigns same weight to links between Web pages,which results in topic drift. In this paper,a new focused crawling approach based on PSO Algorithm is proposed（PSOHITS）. The method electively seeks out pages that are relevant to a pre-defined set of topics using PSO Algorithm,increases the crawling chance of the web page following the web page with the low content-relevance,and broadens the relevant-searching scope of crawlers.Meanwhile,the hyperlink metadata is used to predict the topic-relevance of the web page pointed and quickens the information crawling. Experiments show that the proposed algorithm can improve relevance ratio by 15%~36%.Furthermore,it can well avoid topic drift and improve the accuracy of information collection. It has important theoretical and practical values for search engines research.
H. Q. Zhan "A Improved Topics Search Algorithm Based on PSO Strategy for Web Mining", Key Engineering Materials, Vols. 439-440, pp. 1481-1486, 2010