Effect of Rack-Aware Placement in Cloud Storage System

Article Preview

Abstract:

We are witnessing the rapid development of Cloud Computing techniques and services. Cloud Storage is widely applied in nowadays research and industry community. One of the most hottest topic in cloud storage is the data reliability. To ensure reliability under the condition of inexpensive hardware, several techniques are discussed and applied. We simplify and analyze the data reliability by a markov model, which includes the discussion of correlated failures and rack-aware placement. Our model aims to tell the effect of rack-aware placement for cloud storage systems.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

4446-4450

Citation:

Online since:

October 2011

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2012 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] L. N. Bairavasundaram, G. R. Goodson, B. Schroeder, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau, An analysis of data corruption in the storage stack, in Usenix Conference on File and Storage Technologies (FAST), (2008).

DOI: 10.1145/1416944.1416947

Google Scholar

[2] D. Ford, F. Labelle, F. I. Popovici, M. Stokely, V. -A. Truong, L. Barroso, C. Grimes, and S. Quinlan, Availability in globally distributed storage systems, in OSDI, (2010).

Google Scholar

[3] B. Schroeder and G. A. Gibson, Disk failures in the real world: what does an mttf of 1, 000, 000 hours mean to you?, in Proceedings of Usenix Conference on File and Storage TechnologiesFAST), (2007).

DOI: 10.1145/1288783.1288785

Google Scholar

[4] E. Pinheiro, W. -D. Weber, and L. A. Barroso, Failure trends in a large disk drive population, in Proceedings of Usenix Conference on File and Storage Technologies (FAST), (2007).

Google Scholar

[5] T. Schwarz, M. Baker, S. Bassi, B. Baumgart, W. Flagg, C. van Ingen, K. Joste, M. Manasse, and M. Shah, Disk failure investigations at the internet archive, in NASA/IEEE Conference on Mass Storage Systems and Technologies, (2006).

Google Scholar

[6] W. Jiang, C. Hu, Y. Zhou, and A. Kanevsky, Are disks the dominant contributor for storage failures? a comprehensive study of storage subsystem failure characteristics, in Usenix Conference on File and Storage Technologies (FAST), (2008).

DOI: 10.1145/1416944.1416946

Google Scholar

[7] J. Douceur and R. Wattenhofer, Competitive hill-climbing strategies for replica placement in a distributed file systems, in MIT Report, (2001).

DOI: 10.1007/3-540-45414-4_4

Google Scholar

[8] W. Hsieh, P. Wang, and W. Weihl, Computation migration: Enhancing locality for distributed-memory parallel systems, in Proceedings of the fourth ACM SIGPLAN symposium on Principles and practice of parallel programming. ACM, 1993, p.239–248.

DOI: 10.1145/155332.155357

Google Scholar

[9] J. Dean and S. Ghemawat, MapReduce: Simplified Data Processing on Large Clusters, In Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation (OSDI), Berkeley, CA, USA, (2004).

Google Scholar

[10] Q. Xin, E. Miller, T. Schwarz, D. Long, S. Brandt, and W. Litwin, Reliability mechanisms for very large storage systems, in IEEE/11th NASA Goddard Conference on Mass Storage Systems & Technologies, (2003).

DOI: 10.1109/mass.2003.1194851

Google Scholar

[11] Q. Lian, W. Chen, and Z. Zhang, On the impact of replica placement to the reliability of distributed brick storage systems, in ICDCS, (2005).

DOI: 10.1109/icdcs.2005.56

Google Scholar

[12] M. Chen, W. Chen, L. Liu, and Z. Zhang, An analytical framework and its applications for studying brick storage reliability, in 26th IEEE International Symposium on Reliable Distributed Systems (SRDS), (2007).

DOI: 10.1109/srds.2007.21

Google Scholar

[13] S. Caron, F. Giroire, D. Mazauric, J. Monteiro, and S. Prennes, P2P storage systems: Data life time for different placement policies, INRIA report, (2010).

DOI: 10.1007/978-3-642-15108-8_7

Google Scholar

[14] V. Venkatesan, I. Iliadis, X-Y. Hu, R. Haas, Christina Fragouli , Effect of Replica Placement on the Reliability of Large-Scale Data Storage Systems, in 18th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, (2010).

DOI: 10.1109/mascots.2010.17

Google Scholar

[15] K. V. Shvachko, H. Kuang, S. Radia, R. Chansler. The Hadoop File System, in NASA/IEEE Conference on Mass Storage Systems and Technologies, (2010).

DOI: 10.1109/msst.2010.5496972

Google Scholar

[16] D.Ford, F. Labelle, F. I. Popovici, M. Stokely, V. Truong, L. Barroso, C. Grimes, S. Quinlan, Availability in Globally Distributed Storage Systems , In Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2010. pp.1-7.

Google Scholar

[17] B. Fan, W. Tantisiriroj, L. Xiao, G. Gibson, DiskReduce: RAID for Data-Intensive Scalable Computing. Proceedings of Petascale Data Storage Workshop Supercomputing(PDSW) 09. pp.6-10.

DOI: 10.1145/1713072.1713075

Google Scholar