Rack-Aware Architecture for Reliable Cloud Systems

Abstract:

The ever-growing demand on information and data requires the efficient architecture for large-scale network storage systems. To serve very large scale applications, using inexpensive commodity becomes the common selection in nowadays cloud storage systems. Based on such unreliable hardware, building fault-tolerant mechanism is key issue to the system design. In this paper, we propose a rack-aware architecture for cloud storage systems.

• Periodical: Advanced Materials Research (Volumes 433-440)
• Pages: 5861-5865
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.433-440.5861
• Online since: January 2012
• Authors: Zhen Huang, Yuan Yuan, Yu Xing Peng
• Keywords: Rack-Aware, Redundancy, Reliability

References

[1] A. Greenberg, P. Lahiri, D. A. Maltz, P. Patel, S. Sengupta, Towards a Next Generation Data Center Architecture: Scalability and Commoditization, SIGCOMM (2008).

DOI: 10.1145/1397718.1397732

[2] L. N. Bairavasundaram, G. R. Goodson, B. Schroeder, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau, An analysis of data corruptionin the storage stack, in Usenix Conference on File and Storage Technologies (FAST), (2008).

DOI: 10.1145/1416944.1416947

[3] D. Ford, F. Labelle, F. I. Popovici, M. Stokely, V. -A. Truong, L. Barroso, C. Grimes, and S. Quinlan, Availability in globally distributed storage systems, in OSDI, (2010).

[4] B. Schroeder and G. A. Gibson, Disk failures in the real world: what does an mttf of 1, 000, 000 hours mean to you?, in Proceedings of Usenix Conference on File and Storage TechnologiesFAST), (2007).

DOI: 10.1145/1288783.1288785

[5] E. Pinheiro, W. -D. Weber, and L. A. Barroso, Failure trends in a large disk drive population, in Proceedings of Usenix Conference on File and Storage Technologies (FAST), (2007).

[6] T. Schwarz, M. Baker, S. Bassi, B. Baumgart, W. Flagg, C. van Ingen, K. Joste, M. Manasse, and M. Shah, Disk failure investigations at the internet archive, in NASA/IEEE Conference on Mass Storage Systems and Technologies, (2006).

[7] W. Jiang, C. Hu, Y. Zhou, and A. Kanevsky, Are disks the dominant contributor for storage failures? a comprehensive study of storage subsystem failure characteristics, in Usenix Conference on File and Storage Technologies (FAST), (2008).

DOI: 10.1145/1416944.1416946

[8] S. Ghemawat, H. Gobioff, and S. Leung, The Google File System, Proceedings of the ACM Symposium on Operating Systems Principles, Lake George, NY, October 2003, p.29–43.

DOI: 10.1145/945445.945450

[9] K. V. Shvachko, HDFS Scalability: The limits to growth, Usenix vol 35 no 3, May 2010, www. usenix. org/publications/login/2010-04/openpdfs/shvachko. pdf.

[10] K. V. Shvachko, H. Kuang, S. Radia, R. Chansler. The Hadoop File System, in NASA/IEEE Conference on Mass Storage Systems and Technologies, (2010).

DOI: 10.1109/msst.2010.5496972

[11] M. Chen, W. Chen, L. Liu, and Z. Zhang. An Analytical Framework and Its Applications for Studying Brick Storage Reliability. In Proc. Of SRDS, (2007).

DOI: 10.1109/srds.2007.21

[12] B. Fan, W. Tantisiriroj, L. Xiao, G. Gibson, DiskReduce: RAID for Data-Intensive Scalable Computing. Proceedings of Petascale Data Storage Workshop Supercomputing（PDSW) 09. pp.6-10.

DOI: 10.1145/1713072.1713075