A Deep Web Data Extraction and Application System Based on Cloud Technology

Article Preview

Abstract:

There are so many Deep Webs in Internet, which contains a large amount of valuable data, This paper proposes a Deep Web data extraction and service system based on the principle of cloud technology. We adopt a kind of multi-node parallel computing system structure and design a task scheduling algorithm in the data extraction process, in above foundation, balance the task load of among nodes to accomplish data extraction rapidly; The experimental results show that cloud parallel computing and dispersed network resources are used to extract data in Deep Web system is valid and improves the data extraction efficiency of Deep Web and service quality.

You might also be interested in these eBooks

Info:

Periodical:

Advanced Materials Research (Volumes 756-759)

Pages:

2583-2587

Citation:

Online since:

September 2013

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2013 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] Bergman M K. The Deep Web: Surfacing Hidden Value(White Paper). Journal of Electronic Publishing, (2001).

DOI: 10.3998/3336451.0007.104

Google Scholar

[2] Xiaocheng Liu, Qiang He and Xiaogang Qiu et al. Simulation modelling practice and theory. Vol. 26 (2012), p.135.

Google Scholar

[3] Loughran, Steve, Alcaraz Calero, Jose M., Farrell and Andrew et al. IEEE internet computing. Vol. 16(6)2012, p.40.

Google Scholar

[4] Ralf Lammel , in: Science of Computer Programming, Vol. 70(1)(2008), p.1.

Google Scholar

[5] Giuseppe DeCandia, Deniz Hastorun and Madan Jampani et al. Operating systems review, Vol. 41(6) (2007), p.205.

Google Scholar

[6] Pratt, Brian, Howbert, J. Jeffry, Tasman and Natalie I. et al. Bioinformatics, Vol28(1)(2012), p.136.

Google Scholar

[7] A. Rungsawang and N. Angkawattanawit. Journal of Network and Computer Applications, Vol. 28(2)(2005), p.97.

Google Scholar

[8] Dilip Kumar Sharma, Shobhit University, Meerut and India et al. International journal of information technology and web engineering, Vol. 6(1)2011,: p.25.

Google Scholar

[9] Shunyan Wang, Binghua Wu and Luo Zhong et al. DCABES 2007 proceedings. (2007), p.855.

Google Scholar

[10] Ying Qiao, Gregor v. Bochmann. Computing, Vol. 94(8/10)(2012), p.649.

Google Scholar

[11] Hidetoshi TAKESHITA, Daisuke ISHII and Satoru OKAMOTO et al. IEICE Transactions on communications, Vol. E94-B(4)(2011), p.894.

Google Scholar