Study of Map-Reduce over Hadoop Based Cloud Computing Environment

Wu Min Pan; Li Bai Ha

doi:10.4028/www.scientific.net/AMM.509.175

Paper Titles

Slant-Face Fiber Side Coupling of Vertical Cavity Surface Emitting Laser
p.155

The Relationships of Prior Information and Interval Partition on the Forecasting Effect of Fuzzy Time Series Two-Factor Model
p.159

Research on the Behavior of Intelligent Role in Computer Games Based on Behavior Tree
p.165

Building the Audit Information System in Cloud Computing Environment
p.170

Study of Map-Reduce over Hadoop Based Cloud Computing Environment
p.175

Key Performance Information Collection Architecture Based on Cloud Computing
p.182

Analysis of the Development of Fire Control System
p.189

An Interactive and Artistic Monitoring System for Machine Condition
p.192

Research and Development of Flash-Based Online Virtual Laboratory
p.198

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vol. 509Study of Map-Reduce over Hadoop Based Cloud...

Study of Map-Reduce over Hadoop Based Cloud Computing Environment

Abstract:

Popularity for the term Cloud-Computing has been increasing in recent years. In addition to the SQL technique, Map-Reduce, a programming model that realizes implementing large-scale data processing, has been a hot topic that is widely discussed through many studies. Many real-world tasks such as data processing for search engines can be parallel-implemented through a simple interface with two functions called Map and Reduce. We focus on comparing the performance of the Hadoop implementation of Map-Reduce with SQL Server through simulations. Hadoop can complete the same query faster than SQL Server. On the other hand, some concerned factors are also tested to see whether they would affect the performance for Hadoop or not. In fact more machines included for data processing can make Hadoop achieve a better performance, especially for a large-scale data set.

You might also be interested in these eBooks

Components, Packaging and Manufacturing Technology II

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volume 509)

Pages:

175-181

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.509.175

Citation:

Cite this paper

Online since:

February 2014

Authors:

Wu Min Pan*, Li Bai Ha

Keywords:

Cloud-Computing, Hadoop, MapReduce, SQL

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] I. Shadi, J. Hai, L. Lu, L. Qi, S. Wu, and X. -H. Shi, Evaluating MapReduce on Virtual Machines: The Hadoop Case, in Proceedings of the 1st International Conference on Cloud Computing Beijing, China: Springer-Verlag, (2009).

DOI: 10.1007/978-3-642-10665-1_47

Google Scholar

[2] L. -Q. Li, An optimistic differentiated service job scheduling system for Cloud Computing service users and providers, Qingdao, China, 2009, pp.295-299.

DOI: 10.1109/mue.2009.58

Google Scholar

[3] D. Jeffrey and G. Sanjay, MapReduce: simplified data processing on large clusters, Commun. ACM, vol. 51, pp.107-113, (2008).

DOI: 10.1145/1327452.1327492

Google Scholar

[4] J. L. Johnson, SQL in the Clouds, Computing in Science & Engineering, vol. 11, pp.12-28, (2009).

Google Scholar

[5] Y. -C. Tsay, Application of Java on Statistics Education, Department of Applied Mathematics, National Sun Yat-Sen University, Kaohsiung, Taiwan, July (2000).

DOI: 10.3934/jimo.2009.5.161

Google Scholar

[6] G. Mackey, S. Sehrish, J. Bent, J. Lopez, S. Habib, and J. Wang, Introducing map-reduce to high end computing, " in Petascale Data Storage Workshop, 2008. PDSW , 08. 3rd, 2008, pp.1-6.

DOI: 10.1109/pdsw.2008.4811889

Google Scholar

[7] SQL Server Developer Center, http: /msdn. microsoft. com/en-us/sqlserver/default. aspx.

Google Scholar

[8] Apache, Welcome to Hadoop!, http: /hadoop. apache. org/, (2009).

Google Scholar