Principle Study and Usage of Hadoop Benchmark

Article Preview

Abstract:

Hadoop is the most popular Cloud Computing platform with source code. Its maturity and completeness of ecosystem attract a large number of technical personnel and companies. With the development of a variety of assistive technologies, it is more and more easily to build Hadoop platform. But how to judge a Hadoop platform is built successfully and whether robust enough to be able to put into actual production also requires a series of benchmark tests. This article will introduce the principles and usage methods of Hadoop platform benchmark tools such as Slive, DFSIO and TeraSort. Then compare their results and make a comparison.

You might also be interested in these eBooks

Info:

Periodical:

Advanced Materials Research (Volumes 926-930)

Pages:

1988-1992

Citation:

Online since:

May 2014

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2014 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

* - Corresponding Author

[1] Information on http: /en. wikipedia. org/wiki/Benchmarking.

Google Scholar

[2] Information on https: /issues. apache. org/jira/secure/attachment/12448004/SLiveTest. pdf.

Google Scholar

[3] Information on http: /mail-archives. apache. org/mod_mbox/hadoop-common-user/200901. m box/%3C496EACE2. 2090007@yahoo-inc. com%3E.

Google Scholar

[4] Information on http: /developer. yahoo. com/blogs/hadoop/hadoop-sorts-petabyte-16- 25-hours- terabyte-62-422. html.

Google Scholar

[5] Information on http: /www. ordinal. com/ gensort. html.

Google Scholar

[6] Changkyu Kim, Jongsoo Park, Nadathur Satish, Hongrae Lee, Pradeep Dubey and Jatin Chhugani: ACM SIGMOD International Conference on Management of Data (New York 2012). Vol. 1, pp.841-850.

Google Scholar

[7] Information on http: /sortbenchmark. org/YahooHadoop. pdf.

Google Scholar

[8] Information on http: /sortbenchmark. org/Yahoo2009. pdf.

Google Scholar