Design and Implementation of a Data Parsing Module for Power Information Equipment Log Management System

Abstract:

in order to manage the log information of Windows servers, Linux servers, network devices and security devices in a unified, so as to query log data, analysis and audit log data conveniently, a program is put forward, in which a variety of power system information devices log data be converted into a unified relational model and integrated into the database. The data parsing module uses the Windows Workflow procedure to select, clean and merge the massive log data. The database is created and operated by Microsoft SQL Server 2005 development platform. All of the log files have to be converted into a unified format and saved in centralized storage. Experiments and test results show that the module has a good efficiency of data processing and integration, and it greatly increases the proportion of valid data. It provides supports for efficient log auditing and fault diagnosis in the future.

• Periodical: Advanced Materials Research (Volumes 765-767)
• Pages: 1092-1097
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.765-767.1092
• Online since: September 2013
• Authors: Yi Ting Zhang, Bin Wang, Zhi Hui Zhang
• Keywords: Data Integration, Data Parsing, Information Power Equipments, Log Management

References

[1] L. Yu, S.Y. Wang, An integrated data preparation scheme for neural network data analysis, IEEE Transl. vol. 18, p.928–937, Febrary (2006).

[2] G. O. Silva, E. M.M. Ortega, G. A. Paula, Residuals for log-Burr XII regression models in survival analysis, Journal of applied statistics, vol. 38, p.68–73, July (2011).

DOI: 10.1080/02664763.2010.505950

[3] L. Linsen, J. Locherbach, and M. Berth, Visual analysis of gel-free proteome data, IEEE Transl. vol. 12, p.271–350, April (2006).

DOI: 10.1109/tvcg.2006.82

[4] M. Cocea, S. Weibelzahl, Log file analysis for disengagement detection in e-Learning environments, in User modeling and user-adapted interaction. vol. 19, p.271–350, April (2009).

DOI: 10.1007/s11257-009-9065-5

[5] G. Greco, A. Guzzo, and L. Ponieri, Discovering expressive process models by clustering log traces, IEEE Transl. vol. 48, p.438–446, August (2006).

[6] J. H. Andrews, Z. Yingjun, General test result checking with log file analysis, IEEE Transl. vol. 29, p.635–642, July (2003).

DOI: 10.1109/tse.2003.1214327

[7] M. D. Sidman, F. E. DeAngelis, and G. C. Verghese, Parametric system identification on logarithmic frequency response data, IEEE Transl. vol. 36, August (1991).

DOI: 10.1109/9.83539

[8] T. Dan, C. Rong, D. Zhenjun, and L. Yaqing, A Method of Log File Analysis for Test Oracle, IEEE Conference Publications, vol. 3, p.351–354, April (2009).

[9] T. T. Shwe, T. Myint, and T. T. Aye, Framework for multi-purpose web log access analyzer, IEEE Conference Publications, vol. 3, p.289–293, May (2010).

DOI: 10.1109/iccet.2010.5485874