A Quasi-Real-Time MapReduce Schedule Algorithm

Chun Yan Fu; Hong Zhou; Mao Song Ge; Xiao Qu; Yong Li Wang

doi:10.4028/www.scientific.net/AMR.694-697.2458

Paper Titles

Virtual Function Block Mechanism in the Cloud Manufacturing Environment
p.2438

A Three-Dimensional Virtual Manufacturing System with High Confidence for Turning
p.2442

Vehicle Design and Realization of Virtual Maintenance Training System
p.2449

The Application and Research of the Distributed Electronic Authentication Based Software
p.2454

A Quasi-Real-Time MapReduce Schedule Algorithm
p.2458

A Resource Allocation Algorithm in RFID System
p.2462

Information Security Ontology Model for Internet of Thing
p.2466

Manufacturing Industry in China Informatization Development Analysis Based on the Internet of Things
p.2471

Intelligent Decision Support System in Damage Control of Damaged Ship
p.2476

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 694-697A Quasi-Real-Time MapReduce Schedule Algorithm

A Quasi-Real-Time MapReduce Schedule Algorithm

Abstract:

In this paper, we extend and rewrite MapReduce dispatcher and its quasi-real-time schedule algorithm to support operation scheduling in time-limited. MapReduce dispatcher has an evaluation of completion time of tasks in dependence of rate of progress of tasks at hand, and allocated resource dynamically to every task when they are running. Experimental investigation shows that, the algorithm increase the resource utilization of the MapReduce system, and the goals of quasi-real-time MapReduce schedule has been achieved.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 694-697)

Pages:

2458-2461

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.694-697.2458

Citation:

Cite this paper

Online since:

May 2013

Authors:

Chun Yan Fu, Hong Zhou, Mao Song Ge, Xiao Qu, Yong Li Wang

Keywords:

MapReduce, Priority, Schedule Algorithm, Scheduling Policy

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] Fu Cunyan, Zeng Hui, Wang Haojie, Liu Jingshun. Analysis And Processing Method Of A Data stream Based On Wavelet. ICCDA 2010,2010:1193-1196.

DOI: 10.1109/iccda.2010.5541283

Google Scholar

[2] AbadiDJ. Integrating ComPression and Exeeutionin Colunin-Oriented Database Systems[C]. SIGMODChieagoUSA,2006:671- 682.

Google Scholar

[3] YongqiangZou,JiaLiu,Shieai Wang,LiZha,ZhiweiXu.CChidex:AComPlemental Clustering Index on Distributed Ordered Tables for Multi-dimensional Range Queries.NPC2010,LNCS 6289,2010:247-261.

Google Scholar

[4] APaeheMapRedueeArehiteeture[EB/OL].

Google Scholar

[5] Jason Baker,Chris Bond,JamesC.Corbett,JJ Furman,Andrey Kllorlin,James Larson,Jean-Miehel Leon,Yawei Li,Alexander Lloyd,and Vadim YushPrah.Megastore:Providing sealable,highly available storage for interaetive services.InProc.CIDR,2011.

Google Scholar