Distributed File Information Management System Based on Hadoop

Jun Xiong Sun; Yan Chen; Tao Ying  Li; Ren Yuan  Wang; Peng Hui  Li

doi:10.4028/www.scientific.net/AMR.756-759.820

Paper Titles

Study on Resource Construction and Management of Multimedia Network Teaching
p.800

Security Early Warning Assessment Program of Hazardous Sources Based on Early Warning Information Processing Model
p.804

Research on a Comprehensive Evaluating Model of E-Commerce Website Design Based on AHP
p.810

A Multiprocessor RTOS Design of uC/OS
p.814

Distributed File Information Management System Based on Hadoop
p.820

Design of Framework for Campus Network Transition from IPv4 to IPv6
p.824

Performance Analysis of Improving ZigBee Wireless Network Using AODV Mesh Routing Model
p.828

Model of Improving Searching Precision For Interactive Users with Searching Requirements
p.833

A Quasi IBE Identity Authentication Scheme in a Cloud Computing Environment
p.837

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 756-759Distributed File Information Management System...

Distributed File Information Management System Based on Hadoop

Abstract:

There are two main problems to store the system data on single machine: limited storage space and low reliability. The concept of distribution solves the two problems fundamentally. Many independent machines are integrated as a whole. As a result, these separated resources are integrated together. This paper focuses on developing a system, based on SSH, XFire and Hadoop, to help users store and manage the distributed files. All the files stored in HDFS should be encrypted to protect users privacy. In order to save resources, system is designed to avoid uploading the duplicate files by checking the files MD5 string.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 756-759)

Pages:

820-823

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.756-759.820

Citation:

Cite this paper

Online since:

September 2013

Authors:

Jun Xiong Sun, Yan Chen, Tao Ying Li, Ren Yuan Wang, Peng Hui Li

Keywords:

Distributed, Hadoop, SSH, XFire

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] DingBo, ChaoAinong, Research on AJAX development based on Struts2 framework, Computer Engineering and Design, pp.3910-3913, 2009, 30(16).

Google Scholar

[2] WangMeiqin, Study on Method of Integration of the J2EE Framework Based on Struts, Spring and Hibernate, Computer Knowledge and Technolgy, Vol. 7, No. 24, pp.5911-5913, August (2011).

Google Scholar

[3] Jiang Xiaoping, Li Chenghua, Parallel implementing k-means clustering algorithm using MapReduce programming mode, Huazhong Univ. of Sci. & Tech. (Natural Science Edition), Vol. 39 Sup. I Jun. (2011).

Google Scholar

[4] Weiwei Li, Hang Zhao, Research on massive data mining based on MapReduce, Computer Engineer and Applications, 2012-06-01.

Google Scholar

[5] Hongbo Shi, Zhenxin Wu, Research on a distributed long term preservation system solution based on HDFS, Researches On Library Science.

Google Scholar

[6] Liu Tong, Zhang Yanan, Application of distributed Java Web Services based on Xfire, Journal of Chang chun University of Technology( Natural Science Edition) Vol29, No. 2 Apr (2008).

Google Scholar

[7] Zhang Yizhi, Zhao Yi, Tang Xiaobin, MD5 Algorithm, Computer Science, 2008 Vol 135, NO. 7.

Google Scholar