Load Balancing Algorithm of Stream Data Based on Correlation Analysis

Article Preview

Abstract:

With the development of stream processing technology, achieving load balance of resource accessing becomes one of key problems. However, the existing technologies are difficult to balance the system and maintain the data integrity requirements when large data stream arrive. In this paper, combined with the dynamic load balancing algorithm, we propose a load balancing algorithm of stream data based on correlation analysis (SDCA-LBA). The algorithm analyses correlation of stream data through the window feature statistics. On the basis of ensuring the load balancing of the stream data system, we consider the data correlation. The experiment results show that this method can effectively solve the problem of stream data load balancing, maintain the data integrity, and improve the system data processing capabilities.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

2594-2599

Citation:

Online since:

March 2014

Export:

Price:

$46.00

Permissions CCC:

Permissions PLS:

Сopyright:

© 2014 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

* - Corresponding Author

[1] Jin CQ, Qian WN, Zhou AY. Analysis and management of streaming data: A survey. Journal of Software, 15(8): 1172~1181, (2004).

Google Scholar

[2] QI Kai-yuan, HAN Yanbo, ZHAO Zhuo-feng, MA Qiang. Real-time data stream processing and key techniques oriented to large-scale sensor data. Computer Integrated Manufacturing Systems, 19(3): 641-653, (2013).

Google Scholar

[3] Vasconcelos R O, Endler M. A Dynamic Load Balancing Mechanism for Data Stream Processing on DDS Systems. M. Sc Thesis, Departamento de Informatica, PUC-Rio-Pontifıcia Universidade Católica do Rio de Janeiro, Rio de Janeiro, (2013).

DOI: 10.18089/tms.2016.12204

Google Scholar

[4] ZHANGYu, fang, WEIQin, lei, ZHAO, Ying. Load balancing algorithm based on load weights. Application Research of Compute, 29(12): 4711-4713. (2012).

Google Scholar

[5] Ying Xing, Stan Zdonik, Jeong-Hyon Hwang. Dynamic Load Distribution in the BorealisStream Processor. [C]/Data Engineering, 2005. ICDE 2005. Proceedings. 21st International Conference on. IEEE 791-802, (2005).

DOI: 10.1109/icde.2005.53

Google Scholar

[6] CHEN, Yi-Jiao, LU, Xi-Cheng, SHI, Xiang-Quan, SUN, Zhi-Gang. A Session-Oriented Adaptive Load Balancing Algorithm. Journal of Software, 19(7): 1828-1836, (2008).

DOI: 10.3724/sp.j.1001.2008.01828

Google Scholar

[7] ZHA0, Yan-fang, JlANG, Yun-qi. Study on Session Persistency for Web-Server Load Balancing. Journal of Yunnan University of Nationalities (Natural Sciences Edition), 20(4): 296-300, (2011).

Google Scholar

[8] SUN, Xi-ling, CHEN, Chao, DING, Zhi-ming. Data Allocation Algorithm Based on Visit Capacity and Dependency Evaluation in Cloud. Computer Science, 39(5): 141-146, (2012).

Google Scholar

[9] LU, Jingbo, CHEN, Zhigang, LIU, Anfeng. A Dynamic Regulation Weight Value Scheme for LVS. Computer Engineering, 32(14): 104-106, (2006).

Google Scholar

[10] QIAN, Jiang-Bo, WANG, Zhi-Jie, CHEN, Hua-Hui. Correlation Analysis on Multidimensional Data Streams Based on Base-Windows. PR&AI, 25(3): 435-444, (2012).

Google Scholar