Design and Realization of a Distributed Big Data Management System

Hai Yan Chen

doi:10.4028/www.scientific.net/AMR.1030-1032.1900

Paper Titles

Mini-Language for Effective Definition of the Color Gradients
p.1882

Analysis on Difficulties and Measures of the Age of Big Data Brings to the Enterprise Competitive Intelligence
p.1886

Brief Introduction of the Application of Hard Disk Recovery Cards to Public Computer Lab Management in Higher Vocational Schools
p.1896

Design and Realization of a Distributed Big Data Management System
p.1900

Exception Throwing Analysis and Exception Handling Method for BPEL
p.1905

Jackson's Theorem in Qp Spaces in Polydiscs
p.1909

Pharmaceutical Companies SaaS Cloud Services Management Platform Based Design and Application
p.1913

Infrared Scattering Performance Testing System Design of Power Field On-Site Service Terminal
p.1919

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 1030-1032Design and Realization of a Distributed Big Data...

Design and Realization of a Distributed Big Data Management System

Abstract:

Big Data provides a possibility of handling mass data, which acts as a subversive technique. By the way, traditional relation database is no more effective of mass data that causes distributed database NoSQL to appear and evolve. In this article, we will design and realize a new distributed big data management system (DBDMS), which is based on Hadoop and NoSQL techniques, and it provides big data real-time collection, search and permanent storage. Proved by some experiment, DBDMS can enhance the processing capacity of mass data, very suitable for mass log backup and retrieval, mass network packet grab and analyze, and etc. other applied areas.

You might also be interested in these eBooks

Materials, Transportation and Environmental Engineering II

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 1030-1032)

Pages:

1900-1904

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.1030-1032.1900

Citation:

Cite this paper

Online since:

September 2014

Authors:

Hai Yan Chen

Keywords:

Big Data, Data Query, Data Storage, Distributed, Hadoop, NoSQL

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] Jungkyu Han, Masakuni Ishii, Hiroyuki Makino. A Hadoop Performance Model for Multi-Rack Clusters. Computer Science and Information Technology (CSIT), 2013 5th International Conference, 2013: 265-274.

DOI: 10.1109/csit.2013.6588791

Google Scholar

[2] Chen He, Derek Weitzel, David Swanson, Ying Lu. HOG: Distributed Hadoop MapReduce on the Grid. High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion, 2012: 1276-1283.

DOI: 10.1109/sc.companion.2012.154

Google Scholar

[3] Christian von der Weth, Anwitaman Datta . Multiterm Keyword Search in NoSQL Systems. Digital Object Identifier, 2012: 34-42.

DOI: 10.1109/mic.2011.140

Google Scholar

[4] Karamjit Kaur, Rinkle Rani. Modeling and Querying Data in NoSQL Databases. Big Data, 2013 IEEE International Conference, 2013: 1-7.

DOI: 10.1109/bigdata.2013.6691765

Google Scholar