Research of Cleaning and Quality Control of Data in Investment Research System of Fund Management Company

Abstract:

The consistency of the meaning of data in data warehouse is a key factor that affects the applications based on the data warehouse. In this paper, a system of cleaning and quality control of data in investment research system was built after investigating the estimation system, TA and other business systems of fund management company and analyzing the requirement of users. The system consists of an ETL program, and other products such as oracle, oracle stored procedures. This design approach can meet business requirements, ensure system scalability, simplify the complexity of the development of ETL program and improve the maintainability of the system. The method used in this paper has a high reference value for design and development of application systems that had the same characteristics.

• Periodical: Applied Mechanics and Materials (Volumes 135-136)
• Pages: 743-746
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.135-136.743
• Online since: October 2011
• Authors: Qiang Guo, Ying Liu, Ran Ran Fu
• Keywords: Data Cleaning, Data Quality Control, Estimation System, ETL, Fund Management Company

References

[1] E. Malinowski and E. Zimányi. Hierarchies in a multidimensional model: From conceptual modeling to logical representation. Data & Knowledge Engineering, 2006, In press.

DOI: 10.1016/j.datak.2005.08.003

[2] S. Jajodia and D. Wijesekera. Securing OLAP data cubes against privacy breaches. In Proc. IEEE Symp. On Security and Privacy, 2004, pp.161-178.

DOI: 10.1109/secpri.2004.1301322

[3] S. Luján-Mora, J. Trujillo, and I. Song. A UML profile for multidimensional modeling in data warehouses. In Data & Knowledge Engineering, 2006, In press.

DOI: 10.1016/j.datak.2005.11.004

[4] G. Shankaranarayanan and Y. Cai. Supporting data quality management in decision-making. Decision Support Systems, 2006, In press.

DOI: 10.1016/j.dss.2004.12.006

[5] J. Zubcoff and J. Trujillo. Extending the UML for designing association rule mining models for data warehouses. In Proc. DaWaK, 2005, pp.11-21.

DOI: 10.1007/11546849_2

[6] Y. Sismanis and N. Roussopoulos. The complexity of fully materialized coalesced cubes. In Proc. VLDB, 2004, pp.540-551.

DOI: 10.1016/b978-012088469-8.50049-8

[7] S. Rizzi et al. Towards a logical model for patterns. In Proc. ER, 2003, pp.77-90.

[8] Marotta, F. Piedrabuena, and A. Abelló. Managing quality properties in a ROLAP environment. In Proc. CAiSE, 2006, pp.127-141.

DOI: 10.1007/11767138_10

[9] E. Malinowski and E. Zimányi. Hierarchies in a multidimensional model: From conceptual modeling to logical representation. Data & Knowledge Engineering, 2006, In press.

DOI: 10.1016/j.datak.2005.08.003

[10] Panos Vassiliadis , Alkis Simitsis , Panos Georgantas , Manolis Terrovitis , Spiros Skiadopoulos, A generic and customizable framework for the design of ETL scenarios, Information Systems, v. 30 n. 7, 2005, pp.492-525.

DOI: 10.1016/j.is.2004.11.002