Improving the Small File Synchronous Write Performance for Parallel Filesystem

Jian Huang; Jun Lu

doi:10.4028/www.scientific.net/AMR.403-408.2432

Paper Titles

Performance Analysis of AODV Protocol in Mobile Ad Hoc Networks
p.2415

Research on Network Control System Using Improved EDF Dynamic Scheduling Algorithm
p.2420

Embedded Network Controller and Application in CNC System
p.2424

Pretreatment of Data Fusion in FBG Temperature Sensing Network
p.2428

Improving the Small File Synchronous Write Performance for Parallel Filesystem
p.2432

Characteristic and Influential Factors of Pollution Zone in the Lower Reach of Minjiang Tidal River
p.2437

A Lossless Data Compression Algorithm for Wireless Sensor Networks Based on Linear Regression Model
p.2441

Urban Traffic Corridors Determination Based on Characteristics of OD Data-Nanning City as an Example
p.2445

Directionally Weakened Diffusion for Optical Flow
p.2449

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 403-408Improving the Small File Synchronous Write...

Improving the Small File Synchronous Write Performance for Parallel Filesystem

Abstract:

In parallel filesystem, data for a single file is striped across multiple storage nodes to provide high performance. But the synchronous write performance of the small file is always poor because it is low efficiency to strip the data of small file to multiple storage nodes. So, many parallel filesystem use the uniform distribution method to save whole the small file to on storage node. This storage method of small file leads to the performance bottle of small file synchronous write in parallel file system. This paper presents a high performance automatically cooperative synchronous write mechanism for the small file in parallel filesystem: C-SWM. C-SWM is a set of pure software mechanisms which provide the reliability of synchronous write operations with the performance of asynchronous write operations. The data of asynchronous write in C-SWM are saved on both two cooperative nodes in parallel filesystm before being written to disk. The experiments in this paper prove that the C-SWM can great improve the small file synchronous write performance in parallel filesystem.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 403-408)

Pages:

2432-2436

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.403-408.2432

Citation:

Cite this paper

Online since:

November 2011

Authors:

Jian Huang, Jun Lu

Keywords:

Cooperation Cache, High Performance, Parallel Filesystem, Synchronous Write

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] M. G. Baker, J. H. Hartman, M. D. Kupfer, K. W. Shirriff, and J. K. Ousterhout, Measurements of a Distributed File System, In Proc. 13-th Symposium on Operating Systems Principles, pages 198-212, October (1991).

DOI: 10.1145/121132.121164

Google Scholar

[2] Juszczak, C., Improving the Write Performance of an NFS Server, USENIX Conference Proceedings, Winter 1994, San Francisco, CA, 247-259.

Google Scholar

[3] M. Baker, S. Asami, E. Deprit, J. Ousterhout, and M. Seltzer, Non-volatile Memory for Fast, Reliable File Systems. In Proc. of the 5-th International Conference onArchitectural Support for Programming Languages and Operating Systems, Boston, MA, October 1992, 10-22.

DOI: 10.1145/143365.143380

Google Scholar

[4] Avila, R.B. Navaux, P.O.A. Lombard, Proceedings of the 16th Symposium on Computer Architecture and High Performance Computing, 2004, 100-105.

Google Scholar