Research on Parallel Geo-Spatial Index Replication Strategy Based on PC Cluster System and its 3D Visualization Application

Abstract:

In the field of spatial information, the amount of spatial data becomes more and more large, and every operation becomes more and more complicated. Now, parallel techniques gradually become valid means of resolving this kind of complicated problem. Therefore, this paper studies the spatial partitioning method of massive data and the parallel geo-spatial index replication strategy after fully considering characteristics of PC cluster based on shared-nothing structure. After studying excellent linear mapping characteristics of Hilbert spatial ordering code, this paper applies it to spatial partitioning of data, and gives a concrete algorithm. In this algorithm, the clustering performance of spatial objects is considered, and the balance of data storage on each processing unit is also done, which greatly improves the processing efficiency of parallel spatial database. Based on this, this paper builds the parallel geo-spatial index based on R-tree, and proposes the spatial index replicas update mechanism based on master replica and weak consistency suitable for the parallel environment of shared-nothing structure after deeply analyzing current synchronous mechanisms of replicas. It is a kind of update mechanism based on message with low cost, enhances the power of parallel spatial data access and using PC cluster, and improves the availability of index data. In the field of 3D visualization application, it is also efficient. Experiments prove that the spatial partitioning strategy and the parallel geo-spatial index replication mechanism presented in this paper can improve load balance of system, and enhance performance of the whole system.

• Periodical: Applied Mechanics and Materials (Volumes 241-244)
• Pages: 2969-2975
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.241-244.2969
• Online since: December 2012
• Authors: Yong Jie Wang, Hua Cheng Dou, Shi Jun Deng, Liang Yong Cheng, Li Wang, Jian Ping Li, Ze Bing Zhou
• Keywords: 3D Simulation, Linear Mapping, Parallel Geo-Spatial Index Replication Strategy, Parallel Technique, Spatial Partitioning of Data

References

[1] J. Orenstein: Spatial Query Processing in an Object-Oriented Database System. Proc. ACM SIGMOD. Pp. 326-336, 1986.

DOI: 10.1145/16856.16886

[2] H.V. Jagadish: Linear Clustering of Objects with Multiple Attributes. ACM SIGMOD Conf. Pp. 332-342, 1990.

DOI: 10.1145/93605.98742

[3] C. Faloutsos: Gray Codes for Partial Match and Range Queries. IEEE Trans. on Software Engineering. Vol. 14, no. 10, pp.1381-1393, 1988.

DOI: 10.1109/32.6184

[4] Xiaolin Cao and Zeyao Mo: A Measure-Based High-Dimensional Dynamic Load Balancing Scheme (In Chinese). Chinese Journal of Computers. Vol. 28, no. 9, pp.1440-1446, 2005.

[5] Abel D J and Mark D M: A Comparative Analysis of Some Two-Dimensional Orderings. International Journal of Geographical Information Systems. Vol. 4, no. 1, pp.21-31, 1990.

DOI: 10.1080/02693799008941526

[6] Moon B and Jagadish H V, et al: Analysis of the Clustering Properties of Hilbert Space-Filling Curve. URL: http://www.cs.umd.edu/

[7] Faloutsos C and Roseman S: Fractals for Secondary Key Retrieval. Eighth ACM SIGACT-SIGMOD-SIGART Symposium on Principle of Database System, New York: ACM Press. Pp. 247-252, 1989.

DOI: 10.1145/73721.73746

[8] Oracle Spatial Partitioning: Best Practices An Oracle White Paper. Oracle Corporation, 2004.

[9] Hector Garcia-Molina, Jeffrey D. Ullman, Jennifer Widom: Database System Implementation. Beijing: China Machine Press. 2001.

[10] A. Schiper, A. Sandoz: Uniform Reliable Multicast in a Virtually Synchronous Environment. Proceedings of the 13th International Conference on Distributed Computing Systems (ICDCS-13), Pittsburgh, Pennsylvania, USA: IEEE Computer Society Press. Pp. 561-568, 1993.

DOI: 10.1109/icdcs.1993.287667

[11] R. Guerraoui, A. Schiper: Software-Based Replication for Fault Tolerance. IEEE Computer. Vol. 30, no. 4, pp.68-74, 1997.

DOI: 10.1109/2.585156

[12] M. Wiesmann, F. Pedone, A. Schiper, B. Kemme, G. Alonso: Understanding Replication in Databases and Distributed Systems. Proceedings of the 20th International Conference on Distributed Computing Systems (ICDCS-20). Pp. 464-469, 2000.

DOI: 10.1109/icdcs.2000.840959