A New File Updating Discovery Algorithm Supporting Semantic Synchronization

Abstract:

Updates discovery is the key problem of data synchronization; it has been used to generate updates operations. The traditional algorithms ignore the modify semanteme, cause the updates operations increased. A new file updating discovery algorithm that supports semantic synchronization is proposed in this paper. The algorithm takes advantage of semantic info, which preserved in file system journal, to accurately recognize users originally modify intents. We take the NTFS file system as an example to realize and test the new algorithm. By comparison, the algorithm effectively reduces synchronization requests. Experiments show that, the algorithm cans timely respond to users’ modification and support massive file changes that occurred in short time. The algorithm is designed based on the basic features of file system journal, and can be applied to other file systems.

• Periodical: Applied Mechanics and Materials (Volumes 263-266)
• Pages: 1979-1986
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.263-266.1979
• Online since: December 2012
• Authors: Qiang Li, Li Gu Zhu, Sai Feng Zeng
• Keywords: File Synchronization, Semantic Synchronization, Updates Discovery

References

[1] David Dearman , Jeffery S. Pierce, It's on my other computer!: computing with multiple devices, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, (2008), Florence, Italy

DOI: 10.1145/1357054.1357177

[2] Eric A. Brewer. Towards robust distributed systems. (Invited Talk) Principles of Distributed Computing, Portland, Oregon, July (2000).

[3] Cooper, B.F., Ramakrishnan, R., Srivastava, U., Silberstein, A., Bohannon, P., Jacobsen H.A., Puz, N., Weaver, D., Yerneni, R.: PNUTS: Yahoo!'s hosted data serving platform.Proc. VLDB Endow. 1(2), 1277–1288 (2008)

DOI: 10.14778/1454159.1454167

[4] Y. Saito and M. Shapiro. Optimistic replication. ACM Comput. Surv., 37(1):42-81, (2005)

DOI: 10.1145/1057977.1057980

[5] F. Hupfeld. "Causal Weak-Consistency Replication - A Systems Approach." Dissertation. Humboldt Universität zu Berlin, (2009).

[6] W. Vogels. Eventually consistent. Communications of the ACM, (2009). http://queue.acm.org/detail.cfm?id=1466448

[7] BEST S. How the Journaled File System Performs Logging. Linux Showcase and Conference, Atlanta, (2000): 163-168.

[8] S.Balasubramaniam, Benjamin C.Pierce. What is a file synchronizer?, MobiCom '98 Proceedings of the 4th annual ACM/IEEE international conference on Mobile computing and networking, New York, (1998), 98-108.

DOI: 10.1145/288235.288261

[9] Nikolai Joukov , Timothy Wong , Erez Zadok, Accurate and efficient replaying of file system traces, Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies, pp.25-25, December 13-16, (2005), San Francisco, CA

[10] iFolder. White paper on Open Source Novell iFolder 3.8. http://www.ifolder.com/,(2009)

[11] T. CVS. Tortoisecvs. http://www.tortoisecvs.org/, (2009)

[12] A. Tridgell and P.MacKerras. The rsync algorithm. Technical Report TR-CS-96-05, Australian National Univ.,June (1996).

[13] Benjamin C. Pierce and Jerome Vouillon. What's in Unison? A Formal Specification and Reference Implementation of a File Synchronizer. Technical Report MS-CIS-03-36, Univ. of Pennsylvania, (2004).

[14] Vijayan Prabhakaran , Andrea C. Arpaci-Dusseau , Remzi H. Arpaci-Dusseau, Analysis and evolution of journaling file systems, Proceedings of the annual conference on USENIX Annual Technical Conference, pp.8-8, April 10-15, (2005), Anaheim, CA

DOI: 10.1109/dsn.2005.65

[15] Michael Demmer, Bowei Du, and Eric Brewer. TierStore: A Distributed File-System for Challenged Networks. In Proceedings of FAST,(2008).

[16] Sqlite3, http://www.sqlite.org/