Research and Design of Web Crawler for Music Resources Finding

Xiu Xia Chen; Wen Qian Shang

doi:10.4028/www.scientific.net/AMM.543-547.2957

Paper Titles

Research and Implementation of LED Optical Design Focused Web Crawler
p.2941

An Implement Scheme of Persistence Layer Based on Hibernate
p.2945

A Performance-Based Policy for Job Assignment under Distributed Rendering Environments
p.2949

Research on Java Development Kit Based on Complex Networks
p.2953

Research and Design of Web Crawler for Music Resources Finding
p.2957

Analysis on Technology Framework of 3D Virtual Fitting Based on Network
p.2961

Analysis of the Snort Building Code Based on IDS
p.2965

Research of Information Resource Storage Mode Based on Cloud Storage
p.2969

Serv-U Based Audio Data Transmitting Management System on Broadcasting Stations
p.2973

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vols. 543-547Research and Design of Web Crawler for Music...

Research and Design of Web Crawler for Music Resources Finding

Abstract:

This paper designs an automatic web crawler system which crawls music resources on the Internet. Firstly, this paper gives the architecture of the system and the function of each module; then describes the detailed design of each module; Finally, the key technologies and algorithms used in the system are given in a detailed description, including the use of χ2 statistics to select feature words, TF-IDF algorithm to calculate the weights of feature words, the correlation of web page and music theme using vector space model.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volumes 543-547)

Pages:

2957-2960

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.543-547.2957

Citation:

Cite this paper

Online since:

March 2014

Authors:

Xiu Xia Chen*, Wen Qian Shang

Keywords:

Correlation, Feature Vectors, Music Resource, TF-IDF

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] C. Shi, C. Xu and X. Yang : Research of TFIDF Algorithm, Journal of Computer Applications, 2009, 29(6): 167 -170.

Google Scholar

[2] X. Fang, X. Liu: The Research of Mutual Information Feature Selection in Text Categorization, Computer Engineering and Applications , 2010, 46(34): 123-125.

Google Scholar

[3] Y. Zhang, B. Wan and Z. Xiong: The Research of Feature Dimension Reduction in Text Categorization, Journal of Computer Applications , 2012, 29 (7).

Google Scholar

[4] Y. Ren, R. Yang and M. Yin: Text Feature Selection Method Based on Information Gain, Computer Science, 2012, 39 (11): 127 -130.

Google Scholar

[5] J. Su,B. Zhang and X. Xu: Text Classification Technology Progress Research Based on Machine Learning, Journal of Software, 2006, 17(9) : 1848 -1859.

Google Scholar

[6] Z. Chen, J. Liu and H. Zhai: Web Page Recognition Algorithm Based on Link Analysis in Theme Search Engine, IEEE 2012 Second International Conference on Cloud and Green Computing, 2012: 405-409.

DOI: 10.1109/cgc.2012.42

Google Scholar

[7] H. Liu, D. Liu and Z. Pei: Text Categorization Feature Weighting Method Based on Feature Importance, Computer Research and Development , 2009, 46(10): 1693 -1703.

Google Scholar

[8] X. Zhang: Research and Implementation of Web Mining Oriented Theme Crawler, Master Thesis of Xi'an University of Electronic Science and Technology , (2012).

Google Scholar