Build a Fully Distributed Hadoop Cluster Based on VM Scene

Article Preview

Abstract:

Hadoop learners is limited by practical problems such as hardware devices, the paper intends to solve the multi-machine build Hadoop distributed cluster in VMWare virtual environment. In this paper, three hosts as an example, the research includes the design of the node and network topology, the installation and configuration of the virtual machine, SSH free password login, installation, configuration and management of Hadoop.

You might also be interested in these eBooks

Info:

Periodical:

Advanced Materials Research (Volumes 1049-1050)

Pages:

1962-1965

Citation:

Online since:

October 2014

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2014 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

* - Corresponding Author

[1] Tang S Q, Li Y L, Hu H R. The design and implementation of cloud data computing and storage platform[J]. Computer, Intelligent Computing and Education Technology, 2014: 437.

DOI: 10.1201/b16698-94

Google Scholar

[2] Ishii M, Han J, Makino H. Design and performance evaluation for hadoop clusters on virtualized environment[C]. Information Networking (ICOIN), 2013 International Conference on. IEEE, 2013: 244-249.

DOI: 10.1109/icoin.2013.6496384

Google Scholar

[3] Han Y Q, Zhang Y, Guan W D. Research on Building the Cloud Platform Based on Hadoop[J]. Applied Mechanics and Materials, 2014, 513: 2468-2471.

DOI: 10.4028/www.scientific.net/amm.513-517.2468

Google Scholar

[4] Pandey R V, Schlötterer C. DistMap: a toolkit for distributed short read mapping on a Hadoop cluster[J]. PloS one, 2013, 8(8): e72614.

DOI: 10.1371/journal.pone.0072614

Google Scholar

[5] Padala P. Resource Management in VMware Powered Cloud: Concepts and Techniques[C]. Parallel and Distributed Processing Symposium, International. IEEE, 2013: 581-581.

DOI: 10.1109/ipdps.2013.122

Google Scholar