Design and Implementation of the Automatic Search and Price-Comparison System Based on the Deep Web

Abstract:

With the development of the Internet, the online shopping was increasingly into people's life. In order to provide convenient search and price comparison service for shopping online, this article designs and implements automatic search and comparison system based on Deep web. To overcome the difficulties of data capture from the current dynamic webpage, the background’s data capture of this system implements by watir. The search module for end-users implements by JavaEE. The practical application shows that this system can fully satisfy people’s needs in search and comparison.

• Periodical: Advanced Materials Research (Volumes 121-122)
• Pages: 209-214
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.121-122.209
• Online since: June 2010
• Authors: Pei Guang Lin, Su Ying Zhou, Lin Zhao
• Keywords: Deep Web, Information Retrieval, Ruby, Watir

References

[1] Zhang Xiaolin. Semantic Web and Semantic-based Networked Information Retrieval [J]. Journal of The China Society For Scientific and Technical Information, 2002, 4(21): 413-420.

[2] Song Jun-Feng, Zhang Wei-Ming, Xiao Wei-Dong, Tang Jiu-Yang. Research on Ontology Based Information Retrieval Model [J]. Journal of Nanjing University (Natural Sciences), 2005, 2(41): 189-197.

DOI: 10.1109/eee.2005.98

[3] BrightPlanet. com. The Deep Web: Surfacing hidden value[EB/OL]. http: /brightplanet. com, (2000).

[4] Chang K C, He B, Li C. Structured databases on the Web: Observations and Implications [J]. SIGMOD Record , 2007, 33(3): 61-70.

DOI: 10.1145/1031570.1031584

[5] HE B, PATEL, M ZHANG, Z CHANG,K.C.C. Accessing the Deep Web: A Survey[R]. Technical Report, Department of Computer Science, UIUC, (2004).

[6] Geng Ruifeng, Qian Xuezhong. A Study on Metadata-based Semantic Search Technology [J]. Control & Automation, 2005, 12(21): 122-124.

[7] Wei LIU, Xiaofeng MENG, Weiyi MENG. Research in Data Integration of Deep Web.

[8] Luciano, Juliana, Freire. Searching for Hidden Web Databases[C]. Eighth International Work-shop on the Web and Databases. Baltimore, Maryland, (2005).

[9] J. Cope, N Craswell, D Hawking. Automated discovery of search interfaces on the Web[C]. In 14th Australasian Conference on Database technologies, (2003).

[10] GAO Ling, ZHAO Peng-peng, CUI Zhi-ming. Automatic Judgment of Deep Web Query Interfaces [J]. Computer Technology and Development, 2007, 17(5): 148-151.

[11] ZHAO Peng-peng, GAO Ling, CUI Zhi-ming. Automatic Classification of Deep Web Sources Based on Search Interface Schemas [J]. Microelectronics & Computer, 2006, 23(10): 47-50.