BW-FILERAID: A Kind of File Based Distributed RAID System and Optimization


Article Preview

In the ever-increasing development of network storage technology, distributed RAID has been a hot topic for data reliability and availability. To solve the problem of distributed RAID technology, such as: parallel access difficulty, long rebuild time, small write update and strip alignment problem, we design and implement file level distributed RAID system (BW-FILERAID) based on Blue Whale File System (BWFS). Also we do the research on resource allocation strategy, page cache management with parity data, consistence maintenance, online extension of RAID group, error detect and rebuild and small write optimization in BW-FILERAID. According to the testing results, the writing performance of BW-FILERAID is better than Linux soft RAID about 5%~50%, and the reading performance is equivalent to the RAID0. And it also has excellent extensibility.



Edited by:

Linli Xu, Wenya Tian and Elwin Mao




T. Guo et al., "BW-FILERAID: A Kind of File Based Distributed RAID System and Optimization", Applied Mechanics and Materials, Vols. 80-81, pp. 1208-1216, 2011

Online since:

July 2011




[1] D. A. Patterson, G. Gibson, and R. H. Katz, A Case for Redundant Arrays of Inexpensive Disks (RAID), In Proceedings of the 1988 ACM SIGMOD international conference on Management of data (SIGMOD '88). (1988) 109-116.


[2] D.D.E. Long, B.R. Montague, L.F. Cabrera , Swift/RAID: a distributed RAID system. Computing Systems. Vol. 7. No. 3. (1994) 333-359.

[3] Kai Hwang, Hai Jin, Roy Ho, RAID-x: A New Distributed Disk Array for I/O-Centric Cluster Computing. In Proceeding of Ninth IEEE International Symposium on High Performance Distributed Computing (HPDC '00), (2000) 279.


[4] Peter M. Chen, Edward K. Lee, Garth A. Gibson, Randy H. Katz, David A. Patterson, RAID: High-Performance, Reliable Secondary Storage. ACM Comput. Surv. 26, 2 (1994), 145-185.


[5] Na Wenwu, The Research on Network RAID and Key Technology. Ph. D Dissertation of Institute of Computing Technology, Chinese Academy of Sciences, (2009).

[6] Information on http: /www. opensolaris. org/os/community/zfs.

[7] Information on http: /oss. oracle. com/projects/btrfs.

[8] David Nagle, Denis Serenyi, Abbie Matthews. The Panasas ActiveScale storage cluster — delivering scalable high bandwidth storage. In Proceedings of the 2004 ACM/IEEE Conference on Supercomputing (SC '04). (2004) 53.


[9] Welch B., Unangst M., Abbasi Z., Gibson G., Mueller B., Scalable performance of the panasas parallel file system. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST'08), (2008) 17-33.

[10] Ghemawat S., Gobioff H., Leung S. T., The google file system. In ACM Symposium on Operating Systems Principles (SOSP 03), (2003) 29-43.


[11] Yang Dezhi, Huang Hua, Zhang Jiangang, Xu Lu, Large Capacity, High Performance, High Extensibility of BWFS, Chinese Journal of Computer Research and Development, Vol. 06, (2005) 1028-1033.

Fetching data from Crossref.
This may take some time to load.