Tiered Adaptive Large-Scale Storage System with High Performance

Abstract:

There are various calculations, transmission, and storage devices in terms of performance or reliability characteristics in great physical differences exist of large-scale cluster storage systems. Meanwhile, the actual traffic load data access for storage devices is also not uniform in space and time and there is a big difference. It is unrealistic and unwise if all the data stored on the high-performance devices. In order to resolve this problem effectively, we propose large-scale adaptive tiered storage system architecture in which structure can carry out effective monitoring access to the load and adapting allocation of storage resources based on the application environment. This can fulfill the full potential to the advantages of high-performance storage nodes to improve the performance of large-scale clustered storage systems.

• Periodical: Applied Mechanics and Materials (Volumes 380-384)
• Pages: 2371-2374
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.380-384.2371
• Online since: August 2013
• Authors: Lei Zhang, Li Gu Zhu, Sai Feng Zeng
• Keywords: Adaptive, Large-Scale Storage, Tier

References

[1] S. A. Weil, S. A. Brandt, E. L. Miller, and C. Maltzahn. CRUSH: Controlled, scalable, decentralized placement of replicated data. In Proceedings of the 2006 ACM/IEEE Conference on Supercomputing (SC '06), Tampa, FL, Nov. 2006. ACM.

DOI: 10.1109/sc.2006.19

[2] S. A. Weil, K. T. Pollack, S. A. Brandt, and E. L. Miller. Dynamic metadata management for petabyte-scale file systems. In Proceedings of the 2004 ACM/IEEE Conference on Supercomputing (SC '04). ACM, Nov. (2004).

DOI: 10.1109/sc.2004.22

[3] P. J. Braam. The Lustre storage architecture. http: /www. lustre. org/documentation. html, Cluster File Systems, Inc., Aug. (2004).

[4] L. -F. Cabrera and D. D. E. Long. Swift: Using distributed disk striping to provide high I/O data rates. Computing Systems, 1991, 4(4): 405–436.

[5] David P. Helmbold, Darrell D. E. Long, Tracey L. Sconyers, and Bruce Sherrod. Adaptive disk spin—down for mobile computers. Mob. Netw. Appl., 2000 5(4): 285–297.

[6] E. Pinheiro, R. Bianchini, E. Carrera, and T. Heath. Load balancing and unbalancing for power and performance in cluster-based systems. Proc. Workshop on Compilers and Operating Systems for Low Power, September (2001).

DOI: 10.1007/978-1-4419-9292-5_5