Research on Information Processing with Dynamic Adaptive Job Scheduling Algorithm Based on Hadoop Platform

Xue Ying Jiang; Yao Wang; Yan Yan Meng

doi:10.4028/www.scientific.net/AMR.1046.359

Paper Titles

Reliable Data Transmission Scheme Based on Network Coding in Wireless Sensor Network
p.339

A Semi-Persistent Scheduling Algorithm for VoIP in LTE-Advanced System
p.343

A Time Synchronization Algorithm Based on Cluster-Tree
p.348

The Design of Embedded Ethernet System Based Microcontroller
p.352

Research on Information Processing with Dynamic Adaptive Job Scheduling Algorithm Based on Hadoop Platform
p.359

Research on Information Processing with Delay Fair Scheduling Algorithm Based on Resource Situation
p.363

A Variables Clustering Based Differential Evolution Algorithm to Solve Multistage Goal Programming Model in Defense Projects Portfolio
p.367

Chaotic Clonal Genetic Algorithm for Routing Optimization
p.371

Projection Method for Material Selection Problem with Triangular Fuzzy Numbers
p.375

HomeAdvanced Materials ResearchAdvanced Materials Research Vol. 1046Research on Information Processing with Dynamic...

Research on Information Processing with Dynamic Adaptive Job Scheduling Algorithm Based on Hadoop Platform

Abstract:

Job scheduling and resource allocation problems relate to the overall performance and resource utilization of Hadoop platform. This paper proposes a dynamic adaptive job scheduling algorithm based on Hadoop platform. This algorithm monitors the change of each computing resource nodes in real time. And through the feedback mechanism pass this information to the control node. It implements the purpose of assign the optimal resource for each of tasks.

You might also be interested in these eBooks

Advanced Development of Engineering Science IV

View Preview

Info:

Periodical:

Advanced Materials Research (Volume 1046)

Pages:

359-362

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.1046.359

Citation:

Cite this paper

Online since:

October 2014

Authors:

Xue Ying Jiang*, Yao Wang, Yan Yan Meng

Keywords:

Ant Colony Algorithm, Dynamic Adaptive, Hadoop, Job Scheduling Algorithm

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

* - Corresponding Author

References

[1] Chuanmei Wan. Cloud Computing and Cloud Applications[M]．Electronic Industry Press , (2014).

Google Scholar

[2] Yuanhong Li. Dynamic Load Balancing Based on Feedback Scheduling Algorithm Design and Implementation in a Heterogeneous Environment of Hadoop [D]. Nanjing University, (2012).

Google Scholar

[3] Yuzhou Hu, Bin Fan, et al. An Application in the Automatic Clearing Collection(ACC)System Based on Cloud Computing for Hadoop[J]. Electronics World, 2014, (13): 16-21.

Google Scholar

[4] Chuanhua Deng, Tongrang Fan, Feng Gao. Resource Scheduler Algorithm Based on Statistical Optimization Under Hadoop[J]．Application Resource of Computers，Vol. 30 No. 2，Feb, (2013).

Google Scholar

[5] Charles L. Phillips, John M. Parr. Feedback Control Systems[D]．Science press，2012, 35-74.

Google Scholar