Design of Marine Data Warehouse ETL System

Abstract:

ETL refers to the process of data extracting, transformation and loading and is deemed as a critical step in ensuring the quality, data specification and standardization of marine environmental data. Marine data, due to their complication, field diversity and huge volume, still remain decentralized, polyphyletic and isomerous with different semantics and hence far from being able to provide effective data sources for decision making. ETL enables the construction of marine environmental data warehouse in the form of cleaning, transformation, integration, loading and periodic updating of basic marine data warehouse. The paper presents a research on rules for cleaning, transformation and integration of marine data, based on which original ETL system of marine environmental data warehouse is so designed and developed. The system further guarantees data quality and correctness in analysis and decision-making based on marine environmental data in the future.

• Periodical: Applied Mechanics and Materials (Volumes 668-669)
• Pages: 1374-1377
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.668-669.1374
• Online since: October 2014
• Authors: Wei Jun Wen
• Keywords: Data Cleaning, Data Extracting, Data Transformation, Data Warehouse, ETL, Marine Data

References

[1] William H. I: Building the Data Warehouse, edited by Wiley Publishing(2005).

[2] Deanna Bradshaw, Mark Kennedy: Oracle BPEL process manager developer's guide, edited by Oracle Corporation(2006).

[3] J.W. Han, N. Stefanovic, K. Koperski: Selective Materialization: An efficient method for spatial data cube construction. PAKDD'98(1998).

DOI: 10.1007/3-540-64383-4_13

[4] Zhou Gengui: Data Warahouse and Data Mining, edited by Zhejiang University Press (2004).

[5] Information on http: / bbs. csdn. net/forums/DataWarehouse.

[6] Xia Dengwen, Shi Suixiang, Yu Ge: The Research of Marine Data Warehouse and Data Mining, edited by Marine Science Bulletin(2005).