Data Storage Layout for Object-Based De-Duplication System

Fang Yan; Yu An Tan

doi:10.4028/www.scientific.net/AMM.303-306.2284

Paper Titles

The Deficiency of E-Commerce Contract and some Propose to Perfect
p.2265

A Study of Using Webcam in Computer Classroom Implementation and Research of a Real-Time Monitoring System for Computer Classroom
p.2269

CS-LBF Improved Model for 3D Medical Image Segmentation
p.2272

Implementation and Research of a Real-Time Monitoring System for Computer Classroom
p.2280

Data Storage Layout for Object-Based De-Duplication System
p.2284

Extracting Hot Topics from Microblogging Based on Keywords Detection and Text Clustering
p.2289

The Empirical Research of Behavior Induction and Dynamic Reports in the Laboratory Information Management System
p.2294

Research on Security Analysis of RFID Based on Multiple Readers
p.2298

Case Study of the Application of a Digital Pen to a Defect Checklist of an Apartment Housing Project
p.2303

HomeApplied Mechanics and MaterialsApplied Mechanics and Materials Vols. 303-306Data Storage Layout for Object-Based...

Data Storage Layout for Object-Based De-Duplication System

Abstract:

The world is increasingly awash in more and more unstructured data. Object-based data de-duplication is the current most advanced method and is the effective solution for detecting duplicate data. We developed an energy saving policy for conventional disk based RAID systems. According to the characteristics of object-based data de-duplication, we introduce object layout strategies for unstructured data applications; disk accesses are concentrated in a part of the disks in a long time which is conducive to scheduling other disks into standby or shutdown mode. Our proposed methods reduce energy consumption of de-duplication storage system.

You might also be interested in these eBooks

Sensors, Measurement and Intelligent Materials

View Preview

Info:

Periodical:

Applied Mechanics and Materials (Volumes 303-306)

Pages:

2284-2288

DOI:

https://doi.org/10.4028/www.scientific.net/AMM.303-306.2284

Citation:

Cite this paper

Online since:

February 2013

Authors:

Fang Yan, Yu An Tan

Keywords:

Data Layout, De-Duplication, Object Storage

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] S. Quinlan and S. Dorward, Venti: A New Approach to Archival Storage. In Proceedings of the USENIX Conference on File And Storage Technologies (FAST), January (2002).

Google Scholar

[2] Li xiao, Tan Yu-An, Sun ZhiZhuo, Mass storage Systems and Technologies(MSST), (2011)May 23-27; Denver, CO.

DOI: 10.1109/msst.2011.5937222

Google Scholar

[3] Fang Yan, YuAn Tan. A method of Object-based De-duplication, Journal of Networks, pp.1705-1712, (2011).

Google Scholar

[4] D. Colarelli, D. Grunwald, Massive Arrays of Idle Disks For Storage Archives, Proceedings of the 2002 ACM/IEEE Conference on Supercomputing(2002).

DOI: 10.1109/sc.2002.10058

Google Scholar

[5] E. Pinheiro and R. Bianchini. Energy conservation techniques for disk array-based servers. In Proceedings of the18th International Conference on Supercomputing , p.68–78, June 26 - July 01( 2004).

DOI: 10.1145/1006209.1006220

Google Scholar

[6] AO Li, SHU Ji Wu, LI Ming Qiang, Data Deduplication Techniques, Journal of Software, Vol. 21, No. 5, May 2010, p.916−929.

DOI: 10.3724/sp.j.1001.2010.03761

Google Scholar

[7] Vijayan Prabhakaran, Thomas L. Rodeheffer, and Lidong Zhou. Transactional flash. In Proc. Symposium on Operating Systems Design and Implementation (OSDI), pages 147–160, San Diego, CA, December (2008).

Google Scholar

[8] Charles Weddle, Mathew Oldham, Jin Qian, Andy Wang, PARAID: A Gear-Shifting Power-Aware RAID proc. 5th USENIX Conference on File and Storage Technologies, p.245–260, (2007).

DOI: 10.1145/1288783.1289721

Google Scholar