Design Tradeoffs in Applying CAS to File System Backed by Amazon-S3

Article Preview

Abstract:

This paper first introduces the basic concepts of related technologies and cloud storage, and then analyzes the architecture and components of cloud storage platform which is compatible with Amazon S3. And particularly shows the implementation of CAS (Content Addressable Storage) which also needs to communicate with S3 server. S3fs (Amazon S3-based file system, which called S3fs) is developed through the frame of FUSE based on Amazon S3. The communication between CAS and S3 is transparent for users. S3fs also take the management of chunked file indexed by hash value, which could reduce the consumption of bandwidth caused by synchronization.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

3423-3426

Citation:

Online since:

March 2014

Authors:

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2014 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

* - Corresponding Author

[1] John Gantz, David Reinsel. The Digital Universe Decade – Are You Ready? [R]. EMC sponsored IDC survey. 2010. 5: 2-4.

Google Scholar

[2] D. Hitz, J. Lau, and M. Malcolm. File system design for an NFS file server appliance[C]. Proc. USENIX(San Francisco, CA) 17-21 1994: 235-246.

Google Scholar

[3] R. Pike, D. Presotto, S. Dorward, B. Flandrena, K. Thompson, H. Trickey, P. Winterbottom. Plan 9 from Bell Labs[C]. Computing Systems 8 (1995): 221-254.

Google Scholar

[4] McKnight J, Asaro T, Babineau B. Digital archiving: End-User survey and market forecast 2006-2010[R]. ESG: 2006-(2010).

Google Scholar

[5] Denehy TE, Hsu WW. Duplicate management for reference data[R]. IBM Research Report, RJ 10305 (A0310-017), IBM Research Division, 2003: 6-8.

Google Scholar

[6] Bobbarjung DR, Jagannathan S, Dubnicki C. Improving duplicate elimination in storage systems[C]. ACM Trans. on Storage, 2006, 2(4): 424?448.

DOI: 10.1145/1210596.1210599

Google Scholar

[7] FIPS 180-1. Secure Hash Standard. U.S. Department of Commerce N.I.S. T[S]., National Technical Information Service, Springfield, VA, April (1995).

Google Scholar

[8] Douglas S. Santry, Michael J. Feeley, Norman C. Hutchinson, Alistair C. Veitch, Ross W. Carton, Jacob Ofir. Deciding when to forget in the Elephant file system[C].

DOI: 10.1145/319151.319159

Google Scholar

[9] Dan R. K. Ports, Austin T. Clements, Erik D. Demaine. PersiFS: A Versioned File System with an Efficient Representation[C].

DOI: 10.1145/1095810.1118598

Google Scholar