Design and Development of the Mass Image Storage Platform Based on Hadoop

Xiao Qing Zhou; Jia Xiu Sun; Xing Xian Luo

doi:10.4028/www.scientific.net/AMM.742.721

Paper Titles

User Activity Based Application-Layer DoS/DDoS Attack Defense Algorithm
p.693

Large Scale Motor Group Integrative Management and Control Network System Based on PLC-SCADA under Complex Environment
p.698

Intelligent Operation and Maintenance of Substations Based on Internet of Things (IoT) Technology
p.708

A Heterogeneous Cross-Domain Authentication Model Based on Access Tickets in Virtual Cable Television Network
p.717

Design and Development of the Mass Image Storage Platform Based on Hadoop
p.721

Design on Text Retrieval Algorithm in Cloud Computing Environment
p.726

Multi-Tag RFID Identification and Anti-Collision Algorithm
p.730

A Novel Parameter Optimization Platform of Dynamic Reactive Power Compensator for Composite Power Load
p.737

Leakage Power Reduction in 32-bit Digital Comparator Using Modified Power Gating Technique
p.741

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vol. 742Design and Development of the Mass Image Storage...

Design and Development of the Mass Image Storage Platform Based on Hadoop

Abstract:

With fast development and deep appliance of the Internet, problem of mass image data storage stand out, so the problem of low management efficiency, low storage ability and high cost of traditional storage framework has appeared. The appearance of Hadoop provides a new thought. However, Hadoop itself is not suit for the handle of small files. This paper puts forward a storage framework of mass image files based on Hadoop, and solved the internal storage bottleneck of NameNode when small files are excessive through classification algorithm of preprocessing module and lead-in of high efficiency and first-level of index mechanism. The test manifests that the system is safe, easy to defend and has fine extension quality; as a result, it can reach to a fine effect.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volume 742)

Pages:

721-725

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.742.721

Citation:

Cite this paper

Online since:

March 2015

Authors:

Xiao Qing Zhou*, Jia Xiu Sun, Xing Xian Luo

Keywords:

Distributed Calculation, Hadoop, Massive Images, Storage Framework

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] ZHAO Xiao-yong, YANG Yang, SUN Li-li, CHEN Yu. Hadoop-based storage architecture for mass MP3 files. Journal of Computer Applications[J]. 2012，32(6) : 1724-1726.

DOI: 10.3724/sp.j.1087.2012.01724

Google Scholar

[2] Li Lin, Design and Analysis of the Mass Image Storage Model Based on Hadoop[D], 2011, 11.

Google Scholar

[3] Cui Jie, Li Taoshen, Lan Hongxing. Design and Development of the Mass Data Storage Platform Based on Hadoop. Journal of Computer Research and Development [J]. 2012，49：12-18.

Google Scholar

[4] Liu Jun. Design and Research of the Mass Teaching Resources Storage Platform Based on Hadoop. Computer & Telecommunication[J], 2013, 07.

Google Scholar

[5] Tai Jian-hua. Research of Mass Data Storage Technology Based on Hadoop Platform[D]. 2012, 06.

Google Scholar

[6] Tome White．Hadoop：The Definitive Guide [M]．O'REILLY PRESS，2009：9-13.

Google Scholar

[7] Dean J'Ghemawat S．MapReduce：Simplified data processing on large clusters [C]/ /Proc．Of the 6th Symp．on Operating System Designand Implementation，2004：137-150.

Google Scholar

[8] ZHANG Jian-xun, GU Zhi-min, ZHENG Chao. Survey of research progress on cloud computing. Application Research of Computers. 2010，27(2)：429-433.

Google Scholar

[9] LI Jun, LI Yong. Research on Integrated Frame and Implementation of Federated Heterogeneous Database Application Systems. Application Research of Computers [J]. 2001，18（4）：19-22.

Google Scholar